-- Logs begin at Sun 2022-08-21 00:10:48 UTC, end at Sun 2022-08-21 01:24:03 UTC. -- Aug 21 00:54:52.442842 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 21 00:54:52.451952 dv-cinder-master-3-smb devstack@keystone.service[81498]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 21 00:54:52 2022] *** Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: nodename: dv-cinder-master-3-smb Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: machine: x86_64 Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: clock source: unix Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: pcre jit disabled Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: detected number of CPU cores: 4 Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: current working directory: / Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: detected binary path: /usr/bin/uwsgi-core Aug 21 00:54:52.453978 dv-cinder-master-3-smb devstack@keystone.service[81498]: your processes number limit is 47680 Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: your memory page size is 4096 bytes Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: detected max file descriptor number: 2048 Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: lock engine: pthread robust mutexes Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: thunder lock: enabled Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 21 00:54:52.454585 dv-cinder-master-3-smb devstack@keystone.service[81498]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 21 00:54:52.493554 dv-cinder-master-3-smb devstack@keystone.service[81498]: Python main interpreter initialized at 0x5592a90ee9c0 Aug 21 00:54:52.493554 dv-cinder-master-3-smb devstack@keystone.service[81498]: python threads support enabled Aug 21 00:54:52.493554 dv-cinder-master-3-smb devstack@keystone.service[81498]: your server socket listen backlog is limited to 100 connections Aug 21 00:54:52.493554 dv-cinder-master-3-smb devstack@keystone.service[81498]: your mercy for graceful operations on workers is 90 seconds Aug 21 00:54:52.493930 dv-cinder-master-3-smb devstack@keystone.service[81498]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 00:54:52.493930 dv-cinder-master-3-smb devstack@keystone.service[81498]: *** Operational MODE: preforking *** Aug 21 00:54:52.494241 dv-cinder-master-3-smb devstack@keystone.service[81498]: *** uWSGI is running in multiple interpreter mode *** Aug 21 00:54:52.494241 dv-cinder-master-3-smb devstack@keystone.service[81498]: spawned uWSGI master process (pid: 81498) Aug 21 00:54:52.494451 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 21 00:54:52.496045 dv-cinder-master-3-smb devstack@keystone.service[81498]: spawned uWSGI worker 1 (pid: 81509, cores: 1) Aug 21 00:54:52.496045 dv-cinder-master-3-smb devstack@keystone.service[81498]: spawned uWSGI worker 2 (pid: 81510, cores: 1) Aug 21 00:54:52.496045 dv-cinder-master-3-smb devstack@keystone.service[81498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 00:54:56.795662 dv-cinder-master-3-smb devstack@keystone.service[81510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:54:56.795662 dv-cinder-master-3-smb devstack@keystone.service[81510]: from cryptography.utils import int_from_bytes Aug 21 00:54:56.796550 dv-cinder-master-3-smb devstack@keystone.service[81510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:54:56.796550 dv-cinder-master-3-smb devstack@keystone.service[81510]: from cryptography.utils import int_from_bytes Aug 21 00:54:56.797934 dv-cinder-master-3-smb devstack@keystone.service[81509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:54:56.797934 dv-cinder-master-3-smb devstack@keystone.service[81509]: from cryptography.utils import int_from_bytes Aug 21 00:54:56.798466 dv-cinder-master-3-smb devstack@keystone.service[81509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:54:56.798466 dv-cinder-master-3-smb devstack@keystone.service[81509]: from cryptography.utils import int_from_bytes Aug 21 00:54:56.845597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:54:56.845810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:54:56.845961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] command line args: [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:54:56.846220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:54:56.846368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ================================================================================ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:54:56.846470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:54:56.846611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] admin_token = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.846693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:54:56.846845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] command line args: [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:54:56.846942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_dir = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:54:56.847285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_source = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ================================================================================ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:54:56.847438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] debug = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] admin_token = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.847887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_dir = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_source = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] debug = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.848945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_config_append = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_dir = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_config_append = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.849976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_dir = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.850979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.851926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852692 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.852839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] publish_errors = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.853929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] publish_errors = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] standard_threads = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.854954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_journal = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_json = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_stderr = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.855879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_syslog = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] standard_threads = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.856439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.856650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.856828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.856914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_journal = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.857063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.857149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_json = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.857221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_stderr = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.857304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.857378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_syslog = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.857529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.857608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:54:56.857773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.857853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.858972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.859962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.860905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.861920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.862862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.863977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.864915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.865915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.866977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.867988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.868900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.869957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.870942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.871895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.872929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.873874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.874959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.875993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.876928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.877991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.878963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879442 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.879926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.external = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.880994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.password = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.881925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.token = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.external = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.882935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.password = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.token = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.883923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.884993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.885934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.886975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.887967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.888991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.889963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.890891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.891986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892218 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.892989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.893914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.894869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.895950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.896978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.897903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.898984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.899926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.900876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.901811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.902950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.903943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.904998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.905908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.906921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.907882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.908967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909740 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.909967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.910893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.911857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.912951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.913953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.914897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.915846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.916904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.917986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.918963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.919955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.920959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.921840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.922949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.923914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.924930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.925994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.926932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.927988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.928906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.929993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.930919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:54:56.931420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.931914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.932149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.932391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.932647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.933053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.933369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.933623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.933860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.934106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.934337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.934577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.934809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:54:56.934979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:54:56.960579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.960805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.961027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.963182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.963411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.963629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.969466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.972398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.997473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.997711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.998997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:56.999227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.050974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.051218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.099118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.099350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.100001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.100209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.262577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.262879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.263936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.264153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.264367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.264581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.287067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.287221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.287294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.287382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.287450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.288739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.300193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.300712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.313058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.313193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.313433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.313603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.313878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.314901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.315096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.315325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:54:57.330918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.331053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.331143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:54:57.331224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:54:57.331453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.331579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.331659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:54:57.331724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:54:57.331941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.332946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.333070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.342631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.342801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.342896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.343099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.343224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.343350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.343443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.343656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.350304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.350616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.353184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.353467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.353601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.353720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.353814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.354885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.355356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.355484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.355652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.355816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.355929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.356025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.356291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.356437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.356608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.356880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.378966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.379734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.380432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.380717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.381214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.381504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.385303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.385587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.385911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.386649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.386934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.387218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.392327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.392611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.393577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.393864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.396644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.396903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.397210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.397485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.397761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.397886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.397990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.398197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.398336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.398460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.398550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.398764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.399041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.399316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.399588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.399862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.415363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.415641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.418068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.418349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.419901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.422228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.423048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.423342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.425428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.425721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.427480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.429896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.430577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.433574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.433892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.434189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.434473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.434749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.435019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.435307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.436844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.437127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.437408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.437692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.437953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.438239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.451072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.451364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.451630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.451913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.454582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.454874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.455153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.455387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.458648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.460159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.460439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.462248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.463009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.463303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.463579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.463771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.464003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.464260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.464388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.467205 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.467488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.467768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.468099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.468375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.475377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.475658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.475959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.476235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.476515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.476784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.477071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.479973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.480403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.480710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.480984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.481258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.481565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.481847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.492483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.495561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.497226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.498535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.499986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.500247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.501430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.501709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.502000 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.503079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.504602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.506048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.506327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.506618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.508365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.509786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.512805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.512952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.513073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.513384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.513665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.514424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.517399 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.517686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.517974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.518252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.521493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.521780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.522058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.526070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.526542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.526843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.528953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.529227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.529505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.529780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.530048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.530324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.530575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.530836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.531119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.531391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.531653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.531934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.532201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.532474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.533445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:54:57.533725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.534004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.534273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.534542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.534811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.535082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.535356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.535631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.535919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.536194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.536451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.536728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.536991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:54:57.566442 dv-cinder-master-3-smb devstack@keystone.service[81510]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5592a90ee9c0 pid: 81510 (default app) Aug 21 00:54:57.569832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b165547-a495-44cb-bfa3-fad00a72abbd None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:57.570122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b165547-a495-44cb-bfa3-fad00a72abbd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:57.570391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b165547-a495-44cb-bfa3-fad00a72abbd None None] PATH_INFO: `/v3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:57.571053 dv-cinder-master-3-smb devstack@keystone.service[81509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5592a90ee9c0 pid: 81509 (default app) Aug 21 00:54:57.574612 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sun Aug 21 00:54:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:04.200014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:04.201115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:04.201473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:04.211948 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:04 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:04.221704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:04.222476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:04.223074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:04.301363 dv-cinder-master-3-smb devstack@keystone.service[81510]: INFO dbcounter [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] Registered counter for database keystone Aug 21 00:55:04.320901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG oslo_db.sqlalchemy.engines [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:55:04.328857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writer thread running {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:55:04.532872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG passlib.handlers.bcrypt [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81510) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:55:04.533196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG passlib.handlers.bcrypt [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81510) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:55:04.589420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:04.591038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:04.728333 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:55:05.176738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:05.246891 dv-cinder-master-3-smb devstack@keystone.service[81509]: INFO dbcounter [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] Registered counter for database keystone Aug 21 00:55:05.271968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG oslo_db.sqlalchemy.engines [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:55:05.284105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writer thread running {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:55:05.406161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c203-3c21-4a6f-876f-400ed7561e05 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:05.411717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:05.412365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:05.412638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:05.412900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:05.422186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:05.472391 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:55:05.472649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceec516-8218-46aa-be68-8a1d7a8e1434 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:05.483129 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Aug 21 00:55:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:55:05.490309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:05.513538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0f8e-bbc7-4255-9a66-fdc81e36f09f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:05.518864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:05.520002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:05.520278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:05.520544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] PATH_INFO: `/v3/projects/977498717dcb4d37929af17aaaa0285d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:05.522107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] RBAC: Authorizing `identity:get_project(project_id=977498717dcb4d37929af17aaaa0285d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:05.574469 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:55:05.574877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497916d-4a47-4ff9-8729-62273f948ac7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:05.579553 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Aug 21 00:55:05 2022] GET /identity/v3/projects/977498717dcb4d37929af17aaaa0285d => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:07.482697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b93b-fe19-43fd-81d8-e8274a1b2841 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.483577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b93b-fe19-43fd-81d8-e8274a1b2841 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.483577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b93b-fe19-43fd-81d8-e8274a1b2841 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.490646 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:07.500135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.500599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.500700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.528290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:07.529817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:07.539276 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:55:07.806085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896b93b-fe19-43fd-81d8-e8274a1b2841 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.827637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896b93b-fe19-43fd-81d8-e8274a1b2841 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.833807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.834420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.834689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.834951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.844120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.845921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa527c-dc60-41ed-962f-ebe00887ed2c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.855490 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:55:07.864338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:07.877220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e7920-b978-47c2-9e14-9cd91daae7e9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:07.883667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:07.884354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:07.884602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:07.884929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:07.886511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:07.888951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024506b5-bc23-4c83-ba67-c2a5c6adc8fe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:07.890520 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sun Aug 21 00:55:07 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:09.864225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-5e8c-4682-9c19-042ee6cb31fa None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:09.864805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-5e8c-4682-9c19-042ee6cb31fa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:09.864805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-5e8c-4682-9c19-042ee6cb31fa None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:09.866077 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:09.871626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:09.872119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:09.872219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:09.890383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736ee6-392e-4cde-9898-fa3932b98b84 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:09.890662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736ee6-392e-4cde-9898-fa3932b98b84 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:09.890932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736ee6-392e-4cde-9898-fa3932b98b84 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:09.891070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:09.892212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:09.892350 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:09.897713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:09.897996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:09.898266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:09.942062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG passlib.handlers.bcrypt [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81509) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:55:09.942486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG passlib.handlers.bcrypt [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81509) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:55:09.971716 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:09.988929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:09.990541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:10.091435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:10.230279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.254740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.346812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2882-ff43-42e1-90a7-54b35f082361 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.365420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.381010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.381660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.381941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.382214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.393730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:10.402499 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:10.403851 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:10.404829 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:10.409430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.476988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1889f6-7457-4fbf-b73d-a4bb98b075bf None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.479352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.492590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.513136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0fae7-36db-4b24-a03f-c8b4cb1a3218 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.517959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.518825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.519100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.519366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.547112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.547715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.548019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.548284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.548961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:10.549256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:10.550660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:10.563006 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:10.568806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.595451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:10.597019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:10.673190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881c85-4d36-464b-b703-5e8a75976bca None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.697508 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:10.703695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.706436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.710018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.710687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.710996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.711276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.712468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:10.713976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:10.715795 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:10.721356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.736246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.804385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9da2-5d16-4daf-806c-60bcb3061bee None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.827216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72c4c-06b5-40c0-a278-c9c2b465b7a5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.837425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.838286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.838560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.838824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.857406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:10.858881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:10.862561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:10.863204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:10.863483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:10.863780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:10.864920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:10.866383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:10.868016 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:10.873998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:10.876770 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:10.877948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:10.878798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:10.878798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:10.878798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:10.878798 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:10.883510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:10.942549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.958521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:10.979635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914289-92e0-4e7a-ad76-fdcb5b23acf0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:10.998844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384385-835e-49ea-baaf-fa1d82f6f2d5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:11.020010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:11.020627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:11.020904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:11.021168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.021901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.domain.id=default, user.id=3eef813adda9492db76f71cbcb6b6625) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:11.022201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:11.023673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd421c-2cf6-4755-a1e8-11c78f73d557 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:11.031064 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/role_assignments?user.id=3eef813adda9492db76f71cbcb6b6625&scope.domain.id=default&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:11.032089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:11.032706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:11.032983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:11.033253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:11.033962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:11.034258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:11.035679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171f67-d22f-4da1-84ec-ca7dae467d73 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:11.061389 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:13.132153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dded-3aac-49f5-b54f-78136cc8cd99 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.132682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dded-3aac-49f5-b54f-78136cc8cd99 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.132682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dded-3aac-49f5-b54f-78136cc8cd99 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.134201 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:13.139951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19622723-8331-4d85-9b31-2e8f8bf20b65 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.140374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19622723-8331-4d85-9b31-2e8f8bf20b65 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.140557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19622723-8331-4d85-9b31-2e8f8bf20b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.169337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-19622723-8331-4d85-9b31-2e8f8bf20b65 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:13.170544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-19622723-8331-4d85-9b31-2e8f8bf20b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:13.269672 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:13.304186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655ff7c-fced-4ea7-a982-0a42327bd8ff None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.304467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655ff7c-fced-4ea7-a982-0a42327bd8ff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.304938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655ff7c-fced-4ea7-a982-0a42327bd8ff None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.306427 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:13.312255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab58-56d4-422d-9c6f-20abf2b6935b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.312734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab58-56d4-422d-9c6f-20abf2b6935b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.313152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab58-56d4-422d-9c6f-20abf2b6935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.341003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0a10ab58-56d4-422d-9c6f-20abf2b6935b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:13.342462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0a10ab58-56d4-422d-9c6f-20abf2b6935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:13.393789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:13.426053 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:13.501767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a5ce-6441-4f79-99ad-e8fbee91169b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.502418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a5ce-6441-4f79-99ad-e8fbee91169b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.502904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a5ce-6441-4f79-99ad-e8fbee91169b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.504487 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:13.509707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.510226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.510714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.540767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:13.542729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:13.625127 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:13.705565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a5ce-6441-4f79-99ad-e8fbee91169b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.833222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.841032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a5ce-6441-4f79-99ad-e8fbee91169b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:13.903927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:13.904561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:13.904832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:13.905095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:13.936652 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:13.941900 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:13.942750 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:13.943523 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:13.952693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:13.966588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:14.075946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457fb5f-3a4c-43c3-afd8-843a7f66fdda None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.086421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:14.108931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450c7d-93fc-40b9-8d53-be13999e7f65 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.115542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.116305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.116737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.117111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.117879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.119382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2be9-068a-48cb-b3ef-b7c73b724f52 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.178584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.179107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.179107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.179257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.180002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:14.180304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.181771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.192859 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 16/29] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:14.193759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:14.277759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:14.321929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65587f68-c455-4894-8311-147f7ca5c80c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.344525 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 14/30] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Aug 21 00:55:13 2022] POST /identity/v3/roles => generated 219 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:14.347585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eee77-0f29-411a-9c0c-b7bd0c24d64b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.347985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eee77-0f29-411a-9c0c-b7bd0c24d64b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.348171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eee77-0f29-411a-9c0c-b7bd0c24d64b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.349540 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 15/31] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:14.354479 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eee77-0f29-411a-9c0c-b7bd0c24d64b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:14.384377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.386015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.386287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.386918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.403846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.411967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0b37c264-576d-4ac5-8052-a85f46ef6b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:55:14.445401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:14.446433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:55:14.447258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:55:14.447258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:55:14.447258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:14.447258 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:14.447258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.447514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.448363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.494772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:14.503772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:14.588705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eee77-0f29-411a-9c0c-b7bd0c24d64b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.626041 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:14.627578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:14.646483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.647171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.647450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.647720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.661746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.663223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.665096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 16/34] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:14 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:14.680428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:14.697397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:14.741609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:14.780624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435cd68-d648-49a3-a741-b7d754bddcf6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.825446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.826079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.826416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.829117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.829117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:14.829117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.829347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.846299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c0ac1-d026-47c4-bbc9-bd06b9ad6694 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.850538 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 19/35] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:14.856302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:14.891109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:14.892239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.892719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.893278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.894578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:14.896267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70994dd3-eaed-4d56-8b30-c7d1d5291c3c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:14.901022 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 17/36] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:14.901022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2357-ff55-4d15-929f-3c162c6da223 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.901022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2357-ff55-4d15-929f-3c162c6da223 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.901022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2357-ff55-4d15-929f-3c162c6da223 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.901022 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 18/37] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:14.907178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:14.907178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:14.907468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:14.926507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:14.928261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:14.977600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7fabd-c8a4-47ed-8a86-6b97667fc7df None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:14.988063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.008194 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:15.009317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:15.016904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.023780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.023780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.023780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.023780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.023780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:15.064956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.136966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1adc-3a7c-44c3-ac38-c9b80e8e2def None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:15.173211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.174250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.174719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.175233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] PATH_INFO: `/v3/domains/default/users/3eef813adda9492db76f71cbcb6b6625/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.177388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3eef813adda9492db76f71cbcb6b6625, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.179139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff842928-507a-4be5-b3a3-bd67f29b655c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:15.207762 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:55:14 2022] POST /identity/v3/projects => generated 301 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:15.207762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:15.208385 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1361 bytes} [Sun Aug 21 00:55:15 2022] PUT /identity/v3/domains/default/users/3eef813adda9492db76f71cbcb6b6625/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:15.220111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5890-b81f-4a35-a61c-02e47cdf8fa0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.220111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5890-b81f-4a35-a61c-02e47cdf8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.220111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5890-b81f-4a35-a61c-02e47cdf8fa0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.221739 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 21/41] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:15.228556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.228556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.228864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.249757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:15.251280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:15.349045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78e43-0fa8-4064-869b-bb0a48ca9b0a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:15.370888 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:15.373006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:15.426622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.428440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.429173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.429605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.429866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.430648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.432344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:15.461812 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 21/43] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Aug 21 00:55:15 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:15.522415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bf099-9f20-40a9-a6b0-13fece2532a8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:15.567395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.568047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.568323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.568590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.569265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.570733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:15.592642 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Aug 21 00:55:15 2022] POST /identity/v3/roles => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:15.664494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:15.695167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.796784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd584268-00cc-43d9-87ff-23951758cd02 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:15.831694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.832422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.832704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.832978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.834184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.835671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6290d4f-a278-43d5-9f39-c3551def7c67 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:15.837304 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 22/45] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:15.843175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:15.925801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:15.944568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae6dc-c8aa-4ada-8d98-52a9011e2706 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:15.978567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:15.979095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:15.979371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:15.979638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:15.980362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:15.981810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340dbde-7bd6-486d-8eca-94b1ab79159d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:16.010161 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:55:15 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:17.283949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace366-b433-4677-b213-62b857d958b9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.284473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace366-b433-4677-b213-62b857d958b9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.284473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace366-b433-4677-b213-62b857d958b9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.285872 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:17.291883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.292328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.292401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.311387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:17.312600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:17.383999 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:17.655754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace366-b433-4677-b213-62b857d958b9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.861569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:17.875245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace366-b433-4677-b213-62b857d958b9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:17.911456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:17.912043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.912323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.912595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.924394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-89be0eff-9c30-43ff-aafd-042337b9d219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:17.929254 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:17.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:17.931034 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:17.936901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:17.992327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b8a9-02a8-499d-b68b-b10b8b75ce99 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.992781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b8a9-02a8-499d-b68b-b10b8b75ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:17.993059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b8a9-02a8-499d-b68b-b10b8b75ce99 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:17.994391 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 25/50] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:17.999514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:17.999903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.000178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.002387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:18.018714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:18.020246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:18.041176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ed0c7-5c3f-4d83-871d-cb69382676fd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.077095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.077727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.078001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.078269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.078942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:18.079201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.080660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.092501 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:18.095817 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:18.098499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.205968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec8e0-eb26-4261-85fc-cfe8f45b4f8c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.231240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:18.240538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.241184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.241463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.241733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.242896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.244406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.250702 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:18.251970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.332213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:18.354772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6e91-4fc7-460b-a5a7-022a75f791bd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.361492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.393908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.394560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.394845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.395093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.396283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.397778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.399532 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:18.405901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.466058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0715-87c7-4a8a-9316-2511ad954310 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.499097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.499730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.500039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.500310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.501433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.502892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.503646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93812a80-004c-4eaf-ab7d-48b187f0d894 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.504502 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:18.510035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:18.539066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.539684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.539987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.540253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.540987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.domain.id=default, user.id=3eef813adda9492db76f71cbcb6b6625) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:18.541289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.543163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485c377-0cef-44e6-a40c-3ab79ab1f246 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.549411 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Aug 21 00:55:18 2022] GET /identity/v3/role_assignments?user.id=3eef813adda9492db76f71cbcb6b6625&scope.domain.id=default&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:18.574214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:18.617547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88f46a-c182-468b-92bf-5845c634fbff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:18.654206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:18.654843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:18.655121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:18.655389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:18.656092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:18.657560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3580cb1-97e5-48b4-ab68-28ae7e47ec16 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:18.688199 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Aug 21 00:55:18 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:55:20.613822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c6f1-3d2b-422e-bb43-e026bebbda42 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:20.614329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c6f1-3d2b-422e-bb43-e026bebbda42 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:20.614329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c6f1-3d2b-422e-bb43-e026bebbda42 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:20.615622 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:20.622043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:20.622463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:20.622548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:20.652527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:20.653742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:20.720678 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:21.013756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c6f1-3d2b-422e-bb43-e026bebbda42 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.035773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.133255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c6f1-3d2b-422e-bb43-e026bebbda42 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.182020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.182991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.183616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.184529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.186532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.189414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60c61-4809-44d2-9b2d-51ba82546835 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.192457 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:21.200924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:21.262738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:21.321234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c779-e8c1-494d-826a-542c0c05fb79 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:21.365383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:21.365995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:21.366274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:21.366543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:21.367187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:21.368675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ea69d-9b64-43fd-9b97-1423c703e0b1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:21.401547 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:21 2022] POST /identity/v3/users => generated 275 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:24.249491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47240-70b9-4195-9d25-11164dc359ad None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.250442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47240-70b9-4195-9d25-11164dc359ad None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.250886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47240-70b9-4195-9d25-11164dc359ad None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.252438 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:24.257708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8957-0ee4-4133-b1d9-6c47b80ac308 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.258463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8957-0ee4-4133-b1d9-6c47b80ac308 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.258932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8957-0ee4-4133-b1d9-6c47b80ac308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.288546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a22c8957-0ee4-4133-b1d9-6c47b80ac308 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:24.289930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a22c8957-0ee4-4133-b1d9-6c47b80ac308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:24.393621 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:24.716805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09704d-41a6-489e-a5f1-091d9a8539c1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.717379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09704d-41a6-489e-a5f1-091d9a8539c1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.717819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09704d-41a6-489e-a5f1-091d9a8539c1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.719334 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:24.724750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3c9d5-2912-42d2-a1a7-a4e8c96c8139 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.725226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3c9d5-2912-42d2-a1a7-a4e8c96c8139 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.725698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3c9d5-2912-42d2-a1a7-a4e8c96c8139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.806843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09704d-41a6-489e-a5f1-091d9a8539c1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:24.860753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c7b3c9d5-2912-42d2-a1a7-a4e8c96c8139 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:24.862535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c7b3c9d5-2912-42d2-a1a7-a4e8c96c8139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:24.909055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:24.948767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:24.963185 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:24.971842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc911-721a-4f9f-95f6-6e7c9adb1a4f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.972573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc911-721a-4f9f-95f6-6e7c9adb1a4f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.972992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc911-721a-4f9f-95f6-6e7c9adb1a4f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:24.974671 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 34/66] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:24.982027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09704d-41a6-489e-a5f1-091d9a8539c1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:24.983041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5fb1-7ef9-4bb9-8d3e-889e8f749dd0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:24.983464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5fb1-7ef9-4bb9-8d3e-889e8f749dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:24.984002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5fb1-7ef9-4bb9-8d3e-889e8f749dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.020857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.021353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0b1a5fb1-7ef9-4bb9-8d3e-889e8f749dd0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:25.021513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.021786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.022067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.022556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0b1a5fb1-7ef9-4bb9-8d3e-889e8f749dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:25.035410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-832d7e63-41d9-4b63-91e4-dcd4c2323e6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:25.042732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.043923 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:25.044913 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:25.045753 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 33/67] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.047177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a159f0-a0b7-4ada-bdae-74a7c2976959 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.047534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a159f0-a0b7-4ada-bdae-74a7c2976959 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.047906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a159f0-a0b7-4ada-bdae-74a7c2976959 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.049936 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 34/68] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:25.051874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a159f0-a0b7-4ada-bdae-74a7c2976959 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.101039 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:25.106379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.106379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.106379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.129484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:25.130895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:25.229150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a159f0-a0b7-4ada-bdae-74a7c2976959 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.263904 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 36/70] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:25.265401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.300323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.305488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.306642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.307094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.307511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.308484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:25.308971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.310618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a198-c97c-48ad-91f4-ceda5be6d3f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.317094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.321400 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:25.322864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e733-31b3-499c-bb1c-cf1287c4b50c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.323347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e733-31b3-499c-bb1c-cf1287c4b50c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.323871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e733-31b3-499c-bb1c-cf1287c4b50c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.325290 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 36/72] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:25.328615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e733-31b3-499c-bb1c-cf1287c4b50c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.402941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c1f8-af29-4b9f-ae64-7a1ce09c9375 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.445215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e733-31b3-499c-bb1c-cf1287c4b50c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.446928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.447581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.447896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.448167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.459865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e7ec345e-ac0c-4f4b-ad18-311de695f9fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:25.466889 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.467793 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:25.468636 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.469530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.469814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.470093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.488848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.489034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:25.489410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.489686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.489955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.490393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:25.506636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.508118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.509769 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 37/74] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:25.510529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.570811 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 38/75] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:25.571694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.584739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.586356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.632448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8857d-ee1b-4785-af2c-08926f3199a2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.666902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.667700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.668016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.668372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.679130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:25.682604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a415-4d25-4a1a-b356-f52184f8781c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:25.684155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:25.685046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:25.690939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.720796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.721425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.721704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.721977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.722651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:25.722956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.724393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.737376 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:25.737376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.795399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524a57-a47a-42e6-8e9e-14d68fe91403 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.809015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.814564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:25.832847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.833462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.833744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.834007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.844744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa3ae-d55b-4726-b0cb-31df55a8c044 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:25.881340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:25.881989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:25.882331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:25.882610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:25.883777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.885255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.886907 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:25.888611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:25.905052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:25.906570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:25.986014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e2818-7080-4812-93a4-c298cbae8fca None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.008144 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:26.008993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.020330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.020967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.021242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.021513 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.022183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:26.022482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.023907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.027106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.036727 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.036727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.037674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.108798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c2652-97f8-4eea-a2c9-d4a060475fc3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.131176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2f40c-b6de-491b-a3d4-df2f153a55ff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.141768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.142397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.142671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.142938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.144065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.145529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.147109 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.147898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.168723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.169369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.169652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.169921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.180516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:26.185929 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:26.186971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:26.188012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.235241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.247782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.250729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a3bd-4055-4e1b-ae6c-9e941e1fc2d6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.284240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.284846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.285120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.285388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.286034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.287496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.288660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2d16-5a3d-4752-b259-43a29067110e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.316411 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 41/83] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:26 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:26.317260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.335951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.336677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.336996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.337330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.338667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.340499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.342640 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.343261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.443376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431d82-b641-4eb5-a04e-d55c674a70c4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.466372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a1db-6d21-43a3-936c-6daa305a9453 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.484754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.486487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.486487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.486487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.487279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.489154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.490589 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 42/85] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.491228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.503680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.505700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.512745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.513654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.513902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.514178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.601265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.602780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.619372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ff5f-1645-4f34-a99a-b58135c6a894 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.666147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.667082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.667416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.667861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.668991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:26.669097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.670466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.680538 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.681178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.742669 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 44/87] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:26.744084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.764063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.788528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:26.804344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9f7c-4ba0-4c67-a389-0058910f7ba5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.852430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.853422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.854427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.854991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.856459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:26.857236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.859616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.866733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d17ad-7a42-424c-900e-ecef56149f10 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:26.867728 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:26.868661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:26.906198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:26.906837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:26.907111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:26.907448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:26.993045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:26.994853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:26.996223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1a9a5-f43f-4758-81a8-6d95a267ea47 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.028158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.034182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.039528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.039528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.039528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.041926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.044281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.048439 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.051795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.066655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.131318 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:27.132471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.172478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37430-72d9-4e36-a3ed-34c34250e7ca None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.210611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.211648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.212079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.212509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.213788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.215557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.217726 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 46/91] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.218793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.238333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f385-8761-4859-ba8a-445255383aee None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.267643 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.273093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.273781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.274069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.274406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.304228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.343994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed2a5-a7b3-42c8-b6a1-bb287462bc55 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.358933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.360650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.381906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.382958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.383425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.383933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.385339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.387282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.389834 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 47/92] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.390884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.487206 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 46/93] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:27.488583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.522700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.549943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659b975-90b0-4162-bedf-1b6a7c82247f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.597195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde2ece-6eb8-4a0d-8936-c3ce0f3fc6f1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.634498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.637261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.637992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.638093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.638593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.638761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.639094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.639371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.640157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=3eef813adda9492db76f71cbcb6b6625) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:27.640341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:27.640494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.640972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.641996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.642946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.652460 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 47/94] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.654231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.659514 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 48/95] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/role_assignments?user.id=3eef813adda9492db76f71cbcb6b6625&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.818370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:27.825547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4183f-0d57-41f2-a62c-21f555ab00d5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:27.869968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:27.870844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:27.871228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:27.871648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] PATH_INFO: `/v3/projects/51988d7dd803481590ef8851b4e28b8c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:27.876757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] RBAC: Authorizing `identity:get_project(project_id=51988d7dd803481590ef8851b4e28b8c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:27.878401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f4099-bf91-48d9-826c-cf69b57e1c69 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:27.880696 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/projects/51988d7dd803481590ef8851b4e28b8c => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:27.887167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:27.897131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:28.023729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e29ff-4b55-498d-a242-1f180c7f103d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:28.061250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:28.062149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:28.062559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:28.063003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:28.063905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=51988d7dd803481590ef8851b4e28b8c, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:28.064345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:28.065942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74233-9b40-4bfe-b0c8-5e3c7e596b94 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:28.076900 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:27 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=51988d7dd803481590ef8851b4e28b8c&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:28.864644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64da6e-dbba-45e2-9b90-0a1083f7ae9b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:28.865188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64da6e-dbba-45e2-9b90-0a1083f7ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:28.865188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64da6e-dbba-45e2-9b90-0a1083f7ae9b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:28.866787 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 49/98] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:28.872405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:28.873376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:28.873837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:28.895872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:28.897357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:28.945683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59008-76ca-4184-93f4-c4a6c8a57b6f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:28.946018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59008-76ca-4184-93f4-c4a6c8a57b6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:28.946222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59008-76ca-4184-93f4-c4a6c8a57b6f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:28.947698 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 50/99] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:28.953247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:28.953772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:28.954258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:28.973280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:28.974916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:28.991287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:29.003407 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 50/100] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:29.078096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:29.449436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.561514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d09a-4097-43d9-b152-545ea4c9f39b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:29.601768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:29.602412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.602690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.602960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.616546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:29.621532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:29.622387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:29.623140 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:29.628682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.632856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.764129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:29.805998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2286-888b-4c56-8d09-48793d213445 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:29.816211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:29.824691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b218-afc2-4837-bf26-9eab2979dc73 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:29.844513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:29.845144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.845468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.845743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.846866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:29.848653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:29.851787 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:29.860998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:29.904157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:29.905410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:29.905828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:29.906232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:29.907111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:29.907558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:29.909172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:29.928790 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:29.932712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:30.046531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bf923-82f1-4ac4-b904-0057e1d33837 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:30.100206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:30.116431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:30.117109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.117396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.117670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.118334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:30.119853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb9b3-250a-4da7-a9d5-2c940dfedb44 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:30.137811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61b36-1307-4ef0-8432-82e41839cfdf None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:30.174185 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 53/105] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:55:29 2022] POST /identity/v3/projects => generated 302 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:30.176870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5875-791b-4f5e-b86a-fa7fa6daeaf5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.177164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5875-791b-4f5e-b86a-fa7fa6daeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.177500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5875-791b-4f5e-b86a-fa7fa6daeaf5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.178867 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 54/106] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:30.185913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084165-8cab-451d-b74e-3abde768a208 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.186245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084165-8cab-451d-b74e-3abde768a208 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.186824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084165-8cab-451d-b74e-3abde768a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.211796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:30.212464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.212742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.213013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] PATH_INFO: `/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.227878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9e084165-8cab-451d-b74e-3abde768a208 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:30.229117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9e084165-8cab-451d-b74e-3abde768a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:30.249454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] RBAC: Authorizing `identity:get_user(user_id=409963c8b9e04f1c8ae8a9ab3ac0c39e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:30.251141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:30.255640 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 53/107] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:29 2022] GET /identity/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:30.260806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:30.289485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:30.394244 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:30.480896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c354af-2f12-4a34-bd3b-ed49ca53142b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:30.522584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:30.523223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.523517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.523805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.534339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a11f-fad5-4375-a4b4-57a60e07172d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.534637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a11f-fad5-4375-a4b4-57a60e07172d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.534891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a11f-fad5-4375-a4b4-57a60e07172d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.536321 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 56/109] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:30.550264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0346-41f6-423d-8f6c-f8f14107ae44 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.550563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0346-41f6-423d-8f6c-f8f14107ae44 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.550819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0346-41f6-423d-8f6c-f8f14107ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.583042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d27c0346-41f6-423d-8f6c-f8f14107ae44 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:30.584284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d27c0346-41f6-423d-8f6c-f8f14107ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:30.615017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:30.616547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:30.632023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:30.680107 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 57/110] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:30.685216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb805-72de-4d4e-85d7-90589aa6e229 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.685511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb805-72de-4d4e-85d7-90589aa6e229 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.685795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb805-72de-4d4e-85d7-90589aa6e229 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.687106 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 58/111] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:30.694164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.694487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.694726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.730266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:30.731315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:30.732005 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 54/112] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:55:30.737674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:30.788804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:30.845502 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 59/113] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:30.846429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:30.868574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6949-c71a-409b-a127-02ccd8b4fbc5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:30.892681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:30.920567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:30.921215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:30.921493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:30.921771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:30.925304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:30.926764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:30.928447 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 55/114] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:30 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:30.935380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.039693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77dbd-0afd-4feb-b6c1-f8a8d6a0eb56 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.056991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a32e2-76d9-4cfb-8dd1-83e1649f72d2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.083967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.084635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.084918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.085191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.086134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=409963c8b9e04f1c8ae8a9ab3ac0c39e) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:31.086443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:31.087926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40cf66-00ca-484a-924e-f6bc3db6d901 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:31.094474 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 56/115] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:30 2022] GET /identity/v3/role_assignments?user.id=409963c8b9e04f1c8ae8a9ab3ac0c39e&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:31.095724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0510fe-0f5e-4125-b6bf-18e0f0725a6c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.096025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0510fe-0f5e-4125-b6bf-18e0f0725a6c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.096296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0510fe-0f5e-4125-b6bf-18e0f0725a6c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.097753 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 57/116] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:31.098649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0510fe-0f5e-4125-b6bf-18e0f0725a6c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.111383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.112084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.112784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.113052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.139475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-7f35949d-3652-480b-a53d-d29cfbb9f4df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:31.144950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:31.145853 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:31.146631 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:31.153691 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 60/117] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:31.155825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.156113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.156388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.196536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:31.197660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:31.203007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:31.230679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:31.272963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0510fe-0f5e-4125-b6bf-18e0f0725a6c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.307830 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 61/118] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:31.309532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.315548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.316234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.316562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.316844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.329894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:31.335073 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:31.335980 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:31.336746 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 58/119] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:31.337402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.453066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5980-a6cf-4ea6-be34-37fb06597c58 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.456058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:31.490957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.491642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.491957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.492233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.504220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:31.509616 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:31.510475 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:31.511314 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:31.511924 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 59/120] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:31.512473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.563497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3525f4-b57b-4ab7-baf8-da39481d6f46 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.630293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.630922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.633595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.633883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.634575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:31.637096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:31.638561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:31.641947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edd34-5be2-4bf6-974c-e4d058babd3c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.659828 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 62/121] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:31.660713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.705347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:31.711411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.712076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.712360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.712630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.713311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:31.713615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:31.715174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:31.724691 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 60/122] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:31.725594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.759830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:31.828719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce9d9-0c59-4f3c-9f3c-2541b972b564 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.843693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfe1c5-f89e-49f2-892b-a20c1b9d0750 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:31.879760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.880835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.881255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.881673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.882509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:31.883047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:31.883224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:31.884024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:31.884422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:31.884778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:31.885328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:31.886252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:31.887898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:31.889808 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 61/123] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:31.895228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.896210 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 63/124] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:31.900971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:31.994576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.000064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.002648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696c3d-ba78-4d03-bb87-de14466fbf75 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.019790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2138a69-73e4-412b-9453-12aeaf6eab54 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.038619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.039527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.039972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.040377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.051417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:32.056056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:32.056803 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:32.057892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:32.058975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:32.059707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.059707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.060203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.061343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.061673 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 62/125] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:32.062666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.063082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.070405 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:31 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.070405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.172222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc456a-327e-4882-9634-fbf703ae11ea None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.180634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42741e-b35f-4930-a337-85e51237d438 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.208552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.209424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.209896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.210237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.211596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.213741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.215698 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 65/127] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.217617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.218462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.218895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.219363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.220675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.221281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.222502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.224421 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 63/128] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.229984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.245476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.259296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.343509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eff7d-699b-40c1-a454-74579362b407 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.351846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e764e-c25b-4cf1-92d6-6ab01d16b699 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.386911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.387556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.387861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.388132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.388532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.389350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.389451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.389919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.390378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.390855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.391446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:32.391974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.392689 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 64/129] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.393255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.394250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.407443 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 66/130] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.408302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.490989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.510546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6518a-cba4-4131-b2b4-219ca8066651 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.513060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719121-b39f-4c53-8177-0cefd21dd431 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.528171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.550995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.551665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.551972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.552244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/657a7d451d8d4a50a932e747ca49722f/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.553402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.554301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.554517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, user_id=657a7d451d8d4a50a932e747ca49722f, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.554948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.555390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.556349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.556911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.559319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.561214 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 65/131] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.562131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.574100 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 67/132] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:32 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/657a7d451d8d4a50a932e747ca49722f/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:32.574651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.740209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd4d4-1cca-4807-b728-34dcd2abf59b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.780523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f54f0-6b64-4b80-9c6b-e2758ee7252a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:32.788623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.789559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.790037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.790506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/3eef813adda9492db76f71cbcb6b6625/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.794519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, user_id=3eef813adda9492db76f71cbcb6b6625, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.796341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.814422 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:32 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/3eef813adda9492db76f71cbcb6b6625/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:32.815268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.832150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:32.833259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:32.833810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:32.834269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:32.835679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:32.837509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:32.840092 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 68/134] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:32.855596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.858187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:32.876369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:32.962231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29c36-7601-4d1b-89ca-07307fdf201a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:33.012514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:33.013223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.013515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.013798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/657a7d451d8d4a50a932e747ca49722f/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.017021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, user_id=657a7d451d8d4a50a932e747ca49722f, role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:33.018549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c335-5906-4336-ac3d-d0fa4216ac8c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:33.024387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184b6a-a8c6-4c8b-a532-1b2dbecc1b11 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:33.045821 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 67/135] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:32 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/657a7d451d8d4a50a932e747ca49722f/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:33.047043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b5c7-97a4-4b90-9a27-edc1f7325eb5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.047321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b5c7-97a4-4b90-9a27-edc1f7325eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.047598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b5c7-97a4-4b90-9a27-edc1f7325eb5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.053743 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 68/136] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:33.059539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fca6-a9ca-464a-8692-ce75702959ba None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.059884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fca6-a9ca-464a-8692-ce75702959ba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.060132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fca6-a9ca-464a-8692-ce75702959ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.070006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:33.071352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.071851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.072310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] PATH_INFO: `/v3/projects/51988d7dd803481590ef8851b4e28b8c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.073805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=51988d7dd803481590ef8851b4e28b8c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:33.075905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:33.077784 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 69/137] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:32 2022] GET /identity/v3/projects/51988d7dd803481590ef8851b4e28b8c => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:33.085677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5d52fca6-a9ca-464a-8692-ce75702959ba None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:33.087347 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d52fca6-a9ca-464a-8692-ce75702959ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:33.090520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:33.192219 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:33.194876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8f43-75d6-4d18-a8c4-cc9d19742604 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.195385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8f43-75d6-4d18-a8c4-cc9d19742604 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.195911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8f43-75d6-4d18-a8c4-cc9d19742604 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.197885 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 70/139] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:33.211130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.211765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.212409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.254663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:33.256378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:33.258937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:33.285470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:33.320091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483af9c-07e4-4861-843c-1864ae9ad6e4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:33.359764 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 71/140] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:33.368476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:33.369437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.369916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.370457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] PATH_INFO: `/v3/projects/51988d7dd803481590ef8851b4e28b8c/users/657a7d451d8d4a50a932e747ca49722f/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.372646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51988d7dd803481590ef8851b4e28b8c, user_id=657a7d451d8d4a50a932e747ca49722f, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:33.374337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:33.395224 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 70/141] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:33 2022] PUT /identity/v3/projects/51988d7dd803481590ef8851b4e28b8c/users/657a7d451d8d4a50a932e747ca49722f/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:55:33.646930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:33.772018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69d51-fcfd-4380-a81a-0484e6e06b99 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:33.823503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:33.824253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:33.824521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:33.824789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:33.825922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:33.827390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:33.829239 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 72/142] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:33.834831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:33.837424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:33.847515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:33.998863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3bc1-0a6d-49c9-96b4-d2d4481d4756 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.047573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.048271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.048514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.048778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.069850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1311e-4691-43bc-81d3-9d9c0a73e6a4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.071634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:34.078148 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:34.079033 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:34.079833 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:34.083978 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 73/143] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:34.090742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:34.148477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.149196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.149381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.149650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.150421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:34.151964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:34.169730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:34.198274 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 71/144] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:33 2022] POST /identity/v3/users => generated 283 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:34.204241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:34.262654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9c6f-02a2-4b9a-ac55-b81700d8ad6b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.321896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.322595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.322871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.323136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.324009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:34.324521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:34.326051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:34.339328 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 74/145] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:34.345181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:34.497816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3958-c5f3-4d6a-9d39-565fd530e6e2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.549277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.550299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.550771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.551232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] PATH_INFO: `/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.552613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=409963c8b9e04f1c8ae8a9ab3ac0c39e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:34.554283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:34.556122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 72/146] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:34 2022] GET /identity/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:34.562283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:34.709144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884d15-f6e8-4d32-be76-429ef7d297e2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.739679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:34.747531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.748222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.748506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.750393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.751880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:34.753560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b72b-59b4-4d8d-8da8-c91caa0ceb86 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:34.755460 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 75/147] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:34 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:34.761244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:34.832936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:34.895629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5d6e-6a06-4a53-aa0c-55380312a2a5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:34.939203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:34.939911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:34.940187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:34.940459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/409963c8b9e04f1c8ae8a9ab3ac0c39e/roles/260631726dc04ce6bd3c1b6d7d8a906f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:34.944990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, user_id=409963c8b9e04f1c8ae8a9ab3ac0c39e, role_id=260631726dc04ce6bd3c1b6d7d8a906f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:34.946453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ab81-f99e-49d7-b5f3-1823a2760a49 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:34.974383 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:34 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/users/409963c8b9e04f1c8ae8a9ab3ac0c39e/roles/260631726dc04ce6bd3c1b6d7d8a906f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:35.501611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87841c-2b5f-42ba-ba2b-eb945a457718 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.502127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87841c-2b5f-42ba-ba2b-eb945a457718 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.502127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87841c-2b5f-42ba-ba2b-eb945a457718 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.503823 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 76/149] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:35.509588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324890-94b0-4e69-8ee4-5839a4c22dbf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.510028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324890-94b0-4e69-8ee4-5839a4c22dbf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.510206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324890-94b0-4e69-8ee4-5839a4c22dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.513977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d0489-467f-4230-b4f5-1417001dc7b2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.514308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d0489-467f-4230-b4f5-1417001dc7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.514583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d0489-467f-4230-b4f5-1417001dc7b2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.516243 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 77/150] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:35.529815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023a53-e3bf-4f78-aa37-e35bdafc24a8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.530108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023a53-e3bf-4f78-aa37-e35bdafc24a8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.530365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023a53-e3bf-4f78-aa37-e35bdafc24a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.560993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-80023a53-e3bf-4f78-aa37-e35bdafc24a8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:35.562124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-80023a53-e3bf-4f78-aa37-e35bdafc24a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:35.571849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f4324890-94b0-4e69-8ee4-5839a4c22dbf None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:35.573046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f4324890-94b0-4e69-8ee4-5839a4c22dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:35.708766 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:35.719479 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 78/152] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:35.964862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffcb-6bb1-4ba5-bb14-9b0b04dbd7c7 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.965247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffcb-6bb1-4ba5-bb14-9b0b04dbd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.965508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffcb-6bb1-4ba5-bb14-9b0b04dbd7c7 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.967185 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 75/153] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:35.972684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:35.972966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:35.973229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:35.994048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:35.995324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:36.075751 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 79/154] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:36.086976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7ffcb-6bb1-4ba5-bb14-9b0b04dbd7c7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.154641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:36.170660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.219335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7ffcb-6bb1-4ba5-bb14-9b0b04dbd7c7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:36.275729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:36.286379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:36.287030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.287301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.287566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.313665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4448ae1c-848a-412c-84e6-4ae7d8e19c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:36.318659 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:36.319640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:36.320468 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:36.321630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4047-05fe-4475-841a-f68c51ae40ca None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.321630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4047-05fe-4475-841a-f68c51ae40ca None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.322338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4047-05fe-4475-841a-f68c51ae40ca None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.323661 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 77/156] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:36.340355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.340705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.340982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.366468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4db7-d9e8-4dcf-a35f-ee966b6d8678 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:36.373640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:36.374834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:36.424592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:36.425609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.426083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.426556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.446451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:36.452801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:36.453716 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:36.454657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:36.457835 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 80/157] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:36.458843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.524064 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:36.524827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.626068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:36.635379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7795-6083-4a28-8892-a5f6a7cb865f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:36.663277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:36.701823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:36.703392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.703935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.704410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.705284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:36.705786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:36.707369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:36.721097 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 81/159] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:36.722416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.761121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a55e9-1f49-4f35-a9d9-e259c140b055 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:36.836381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:36.837736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.838367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.840647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:36.842543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:36.844171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:36.845789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:36.866966 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 79/160] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:36.867845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:36.922573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1bf54-ee5f-47d5-9de3-f0adf4e86297 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:36.986171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:36.987202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:36.987813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:36.988299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.008843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:37.015239 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:37.016199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:37.017065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:37.019490 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 82/161] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:37.024741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.054444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b16-596d-4302-ab2c-d9e92d183ea3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.056058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.090828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.103361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.104040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.104359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.104724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.108856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.108856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.109717 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 80/162] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:36 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:37.110468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.204851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd9773-64dc-4b2c-96ec-681d5c06628e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.222423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d620d-ed5b-426c-aa6e-7d638f7dbf6f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.256844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.257453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.257728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.258002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.258679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:37.258977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.260504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.269239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.269583 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 81/163] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:37.270314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.270646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.271119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.271589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] PATH_INFO: `/v3/users/3eef813adda9492db76f71cbcb6b6625` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.273088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] RBAC: Authorizing `identity:get_user(user_id=3eef813adda9492db76f71cbcb6b6625)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.274948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.277763 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 83/164] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/users/3eef813adda9492db76f71cbcb6b6625 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:37.278808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.318064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.400657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98943c-5b59-48e2-b165-a31a11f1cae4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.428579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94751-3ec2-4001-9d98-fa152d84251d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.435257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.435903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.436178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.436451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.442839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.500389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.501532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.502033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.502780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.513354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.514977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.524011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:37.530436 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:37.531368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:37.532196 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:37.539762 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 84/165] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:37.541011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.546085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.700160 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 82/166] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:37.701416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.724479 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df573e76-e09e-4adf-bedb-30a217fa20d8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.764556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.765296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.765572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.765838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.766991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.768644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.771079 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 85/167] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:37.771873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.808631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.884168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0133d3-ca96-4847-9f3c-747164049ab3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.901977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c9fe-4b66-4a6c-aa2a-9f64377911f4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:37.919173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.919804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.920081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.920348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:37.921020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:37.921314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:37.922701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:37.931196 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 86/168] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:37.932091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:37.938068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:37.944302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:37.945476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:37.945958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:37.946434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.020403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.022247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.077529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.085378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e2ad-0f98-454c-90b1-d977fbe11f2f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.130264 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 83/169] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:38.131496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.142865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.143511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.143811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.144080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.148688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.149903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.151593 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 87/170] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:37 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.152432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.165423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.240623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134541-ab82-4148-9e2c-b931a295cb2f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.277650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.278618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.279100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.279572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.313585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc7a0-c79a-45c7-a415-eaed4cb3a142 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.356466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.357973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.389446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.400994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.401743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.402160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.402434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] PATH_INFO: `/v3/users/657a7d451d8d4a50a932e747ca49722f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.403789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] RBAC: Authorizing `identity:get_user(user_id=657a7d451d8d4a50a932e747ca49722f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.405276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.416247 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 88/171] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/users/657a7d451d8d4a50a932e747ca49722f => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.417998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.464836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.467590 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 84/172] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:38.468349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.536624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146e28-56ab-4c20-b65a-cd456469dad6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.572201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.572840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.573111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.573470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.574568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.576059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d220fc-888a-40ec-9c23-6dd944142bcd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.576736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57f41d-03fc-4ed9-bfb0-16eec7356521 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.578001 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 89/173] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.578889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55cbd-601b-4fd2-9c5e-d2af1528e6f8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.579159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55cbd-601b-4fd2-9c5e-d2af1528e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.579425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55cbd-601b-4fd2-9c5e-d2af1528e6f8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.580709 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 90/174] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:38.581396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55cbd-601b-4fd2-9c5e-d2af1528e6f8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.609531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.615707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.616385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.616663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.617839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.618600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:38.618909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.620473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.627263 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 85/175] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.627865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.682967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.686866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55cbd-601b-4fd2-9c5e-d2af1528e6f8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.722593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.723213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.723488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.723766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.744956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d77e-5365-454f-8c64-5ebec71a9d1e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.784114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.785052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.785519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.786031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] PATH_INFO: `/v3/projects/51988d7dd803481590ef8851b4e28b8c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.787387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] RBAC: Authorizing `identity:get_project(project_id=51988d7dd803481590ef8851b4e28b8c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.789269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.791156 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 86/176] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/projects/51988d7dd803481590ef8851b4e28b8c => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.792557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.796456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.797935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e65fe-8ef3-435b-a8b7-53850fb9f9ad None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.864586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.909826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff673b4-ae86-45ed-a923-491d77c791b8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:38.947721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:38.948948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.949242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.949605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.950351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=3eef813adda9492db76f71cbcb6b6625) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:38.950658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:38.952262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:38.953113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:38.961178 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 91/178] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:38.962809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297921-4fc6-4447-81af-20c4fcdd2d6f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:38.963376 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 87/178] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/role_assignments?user.id=3eef813adda9492db76f71cbcb6b6625&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:38.963568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297921-4fc6-4447-81af-20c4fcdd2d6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:38.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:38.966215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297921-4fc6-4447-81af-20c4fcdd2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:38.985538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0a297921-4fc6-4447-81af-20c4fcdd2d6f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:38.987144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0a297921-4fc6-4447-81af-20c4fcdd2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:39.086675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c566ee-880a-40c4-bbe5-fe94b0c1f333 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.103129 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 92/179] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:39.105263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042b0a-5663-4580-9141-832798d7900c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.105774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042b0a-5663-4580-9141-832798d7900c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.106314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042b0a-5663-4580-9141-832798d7900c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.112133 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 93/180] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:39.113229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f042b0a-5663-4580-9141-832798d7900c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.120652 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.125194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.125868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.126146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.126414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.127205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=51988d7dd803481590ef8851b4e28b8c, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:39.127511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:39.132801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2d176-683f-49e5-9b60-963994bfa74e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:39.144926 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 88/181] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:38 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=51988d7dd803481590ef8851b4e28b8c&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:39.146228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dad0-b2ae-4b0a-93d5-97e2c273343c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.146531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dad0-b2ae-4b0a-93d5-97e2c273343c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.146814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dad0-b2ae-4b0a-93d5-97e2c273343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.178067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2be1dad0-b2ae-4b0a-93d5-97e2c273343c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:39.179421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2be1dad0-b2ae-4b0a-93d5-97e2c273343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:39.251684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f042b0a-5663-4580-9141-832798d7900c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.287625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.287836 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 89/182] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:39.290778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6740c-e1b9-4354-a5dd-d8458d1575a8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.290778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6740c-e1b9-4354-a5dd-d8458d1575a8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.290998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6740c-e1b9-4354-a5dd-d8458d1575a8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.298650 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 90/183] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:39.298858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.298858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.298858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.298858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.303277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:39.304747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:39.306562 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 94/184] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:39 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:39.307310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9560b4f-296f-43a5-863e-665344df7558 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.307615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9560b4f-296f-43a5-863e-665344df7558 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.307924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9560b4f-296f-43a5-863e-665344df7558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.312964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.339806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d9560b4f-296f-43a5-863e-665344df7558 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:39.341103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9560b4f-296f-43a5-863e-665344df7558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:39.434029 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 91/185] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:39.435691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8bd1d-c334-4b75-ae3a-09486d8d9998 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.436013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8bd1d-c334-4b75-ae3a-09486d8d9998 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.436379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8bd1d-c334-4b75-ae3a-09486d8d9998 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.438434 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 92/186] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:39.445070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.445070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.445070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.464226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:39.465143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:39.496361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d586bd-fbf5-4a64-8cb9-c0f8b4169873 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.517727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.541136 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 93/187] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:39.555176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.556202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.556670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.557144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.558125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=657a7d451d8d4a50a932e747ca49722f) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:39.558651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:39.560328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:39.573111 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 95/188] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:39 2022] GET /identity/v3/role_assignments?user.id=657a7d451d8d4a50a932e747ca49722f&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:39.626399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.651250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.736511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.782086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298159-8d0b-405f-9a4b-845d5ce8d27b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.819325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.819986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.820254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.820524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.823790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:39.823927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c4bd-6167-47b4-9a42-aa4787f4192b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.824008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:39.825361 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 96/189] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:39.830805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.877909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.878490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.878766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.879033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.897069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:39.905668 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:39.906567 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:39.907427 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 94/190] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:39.908296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:39.953549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd65-e7a0-423f-af0b-e9c2c3fc444d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:39.966994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.983411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:39.989935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:39.990582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:39.990860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:39.991129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:39.991803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:39.993247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.014323 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 97/191] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:39 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:40.015143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.031778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876ba8-ba5b-4a10-bacb-9d8828a45cf0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.070339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.070975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.071245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.071513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.083859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:40.088804 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:40.089883 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:40.090704 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 95/192] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:40.091388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.128422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d3e4-3a3b-4bfd-a63e-00de001fb8a7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.163002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.163629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.163936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.164207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.164884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:40.165181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.166929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.175371 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 98/193] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.180837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.206015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f686-c52f-4426-88a0-4002b48f8230 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.208498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.235866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.252985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.254743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.254743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.254743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.269981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:40.274833 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:40.275766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:40.276690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:40.277915 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 96/194] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:40.277915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.314050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ce13-c126-4081-9575-8d6f26a9a0b0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.359380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.360127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.360407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.360690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.361353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:40.361654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.363054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.373267 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 99/195] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.373267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.409087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d72b1-e1fc-493c-b4a3-e530d8e0ee0c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.447702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.448675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.448981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.449367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.463679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.465359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.467302 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 97/196] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.472149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.496030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.512869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc775f-d730-4411-a89c-96443c05ab53 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.525558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.551659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.552448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.552769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.553103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.553845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:40.554565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.555730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.564490 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 100/197] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.565860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.595825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d1acb-4e19-4a56-8275-bb9a46566f62 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.637055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.637737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.638073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.638410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] PATH_INFO: `/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.639641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] RBAC: Authorizing `identity:get_user(user_id=409963c8b9e04f1c8ae8a9ab3ac0c39e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.641292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.647550 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 98/198] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/users/409963c8b9e04f1c8ae8a9ab3ac0c39e => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.647550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.697407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d876557-79ed-4f08-9542-bffc47a95ba7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.738176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.739986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.740460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.740910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.758392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.772258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f41e6-ac32-41b5-8ef9-52f70419daca None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.798761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:40.811615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.812406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.812748 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.813083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:40.814371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.815936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.818084 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 99/199] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:40.818918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.832845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:40.836227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:40.953051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c44493-2a90-4e9a-86b6-b327c7e4d359 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:40.958697 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 101/200] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:40.963905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:40.992248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:40.993221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:40.993686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:40.994286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.021335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.035043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.066159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af3b41-7afc-4eaa-8292-b8dd04ea61c3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.070188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.071914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.100551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.101177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.101458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.101721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.171474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.173079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.183775 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 100/201] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:41.185122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.246638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.251682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.279898 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:41.280584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.304923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb281-96b7-4ca4-84a5-7f6f4be0f938 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.350576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.351623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.352140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.352680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.354399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.356267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.358681 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 101/203] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:41.359822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.383314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0930-37f9-460d-aa19-a62c73275e0f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.418787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.419229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.419509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.419807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.420950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.422411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.427778 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 103/204] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:41.427778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.466004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.471505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2e10-1819-4cb7-81ff-22b008adee8b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.499576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.509036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.509914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.510397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.511102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.513149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.515801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.518756 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 102/205] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:41.519878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.528717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dd50f-f672-456e-b322-f0c5cbab8719 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.563954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.564863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.565438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.565438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.566127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=88b80b43a4d14a8e825325315bf5a356) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:41.566437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.567926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.573871 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/role_assignments?user.id=88b80b43a4d14a8e825325315bf5a356&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:41.574681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:41.649307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8f4e-b1f5-4f5d-89ed-2a5a41b6fcf7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.712321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.712946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.713224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.713493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.714440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8, user.id=409963c8b9e04f1c8ae8a9ab3ac0c39e) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:41.715165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.724675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf30f-69b0-43f9-be12-f08353ee8a13 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.743768 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 103/207] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/role_assignments?user.id=409963c8b9e04f1c8ae8a9ab3ac0c39e&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:41.750160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c4f1-253d-45ec-b46d-517d00dce5c1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:41.753412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:41.798822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:41.799766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:41.800215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:41.800676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:41.801584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=88b80b43a4d14a8e825325315bf5a356) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:41.802056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:41.803680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205faf-ea43-4f0d-a7b4-dd1005f5ac7d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:41.816009 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:41 2022] GET /identity/v3/role_assignments?user.id=88b80b43a4d14a8e825325315bf5a356&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:42.130494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c57fc-f9eb-4ed9-bae4-e5dad854bc69 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.130796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c57fc-f9eb-4ed9-bae4-e5dad854bc69 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.131069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c57fc-f9eb-4ed9-bae4-e5dad854bc69 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.132750 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:42.139407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ce21-0c5f-4132-8cfc-cd28d1f3d8de None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.140406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ce21-0c5f-4132-8cfc-cd28d1f3d8de None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.140897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ce21-0c5f-4132-8cfc-cd28d1f3d8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.161039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a8e0ce21-0c5f-4132-8cfc-cd28d1f3d8de None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:42.163561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a8e0ce21-0c5f-4132-8cfc-cd28d1f3d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:42.253427 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:42.290223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261403c-f598-4287-aa03-315b6ccc2e31 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.290504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261403c-f598-4287-aa03-315b6ccc2e31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.290769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261403c-f598-4287-aa03-315b6ccc2e31 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.292944 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 105/211] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:42.298426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.298714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.298988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.323582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:42.324791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:42.393025 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 107/212] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:42.526300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261403c-f598-4287-aa03-315b6ccc2e31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:42.586898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:42.635311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261403c-f598-4287-aa03-315b6ccc2e31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:42.662280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:42.670136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:42.670791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.671046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.671311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.684059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:42.689725 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:42.690621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:42.691458 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:42.693099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:42.698416 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 106/213] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:42.700193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:42.772451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a948-354a-439f-9470-e738918247d7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:42.804464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781d55-42e4-42c3-a46a-7623bd4c523e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:42.810956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:42.811896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.812455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.812910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.814285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:42.816060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:42.817886 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 108/214] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:42.823558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:42.827767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:42.846789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:42.848098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.848577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.849294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.850213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:42.850708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:42.852924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:42.865012 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 107/215] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:42.874975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:42.936289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:42.943282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30253c3-f6fc-4397-93a5-7004ca4ee0c8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:42.984177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:42.984781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:42.985061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:42.985332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:42.985985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:42.987703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:43.012916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351337-2003-4d88-a49e-558e9cc922db None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:43.019762 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 109/216] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:42 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:43.053714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:43.054393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.054705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.054930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] PATH_INFO: `/v3/users/18c4dead86294f9f8110583d61e1f4d7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.070959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] RBAC: Authorizing `identity:get_user(user_id=18c4dead86294f9f8110583d61e1f4d7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:43.072542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:43.074807 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 108/217] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:42 2022] GET /identity/v3/users/18c4dead86294f9f8110583d61e1f4d7 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:43.085256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:43.200178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afa50-2e89-4ef2-b193-81f5d5911ffb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:43.235255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:43.235955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.236231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.236501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.260415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:43.314577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:43.316078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:43.418804 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 110/218] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:43.424580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:43.463057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:43.534447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3777-dc0b-49a6-bdac-47f891e094c7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:43.577166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:43.577822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.578142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.578418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.584434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:43.585919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30220505-0de3-4db6-8247-2f84eaed6400 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:43.587983 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 109/219] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:43 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:43.594160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:43.647075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d0ca2-7f96-4296-a17d-3bbb97678c64 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.647424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d0ca2-7f96-4296-a17d-3bbb97678c64 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.647626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d0ca2-7f96-4296-a17d-3bbb97678c64 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.649140 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 110/220] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:43.654744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081885be-80bf-406c-8923-0a2b75ffa7e5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.655340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081885be-80bf-406c-8923-0a2b75ffa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.655833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081885be-80bf-406c-8923-0a2b75ffa7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.662025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:43.677268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-081885be-80bf-406c-8923-0a2b75ffa7e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:43.679171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-081885be-80bf-406c-8923-0a2b75ffa7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:43.766010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3838-d0df-41be-b096-3633b520b345 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:43.801486 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:43.808257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:43.808880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.809164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.809430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.810169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=18c4dead86294f9f8110583d61e1f4d7) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:43.810469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:43.811946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc13a2-b277-4e3a-8b8e-154a8abb138b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:43.817978 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 111/222] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:43 2022] GET /identity/v3/role_assignments?user.id=18c4dead86294f9f8110583d61e1f4d7&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:43.863664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e46dc-b40a-48de-8434-9109ed74c08e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.864022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e46dc-b40a-48de-8434-9109ed74c08e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.864250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e46dc-b40a-48de-8434-9109ed74c08e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.865831 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 112/223] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:43.872104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:43.872441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:43.872657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:43.894018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:43.895198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:43.994527 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 112/224] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:44.097872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e46dc-b40a-48de-8434-9109ed74c08e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.142666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:44.212344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e46dc-b40a-48de-8434-9109ed74c08e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.246407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:44.247088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:44.247363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:44.247625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:44.258057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:44.263064 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:44.263992 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:44.264803 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 113/225] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:44.270290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.362833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:44.365679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.434853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758260-6abd-49b8-94cf-50d6588243db None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.479431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:44.484340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190809ca-0d44-46d0-a062-52b683f4cafc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.500505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:44.501148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:44.501432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:44.501707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:44.502396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:44.502698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:44.504110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:44.518833 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 113/226] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:44.525271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:44.525559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.525963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:44.526238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:44.526553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:44.537938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:44.543413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:44.544328 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:44.545131 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 114/227] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:44.553492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.667590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff689f-56c8-4379-828b-19e1f74ace27 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.706493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:44.707145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:44.707380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:44.707643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:44.708582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:44.708876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:44.711174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:44.727771 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 115/228] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:44.732726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.772100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:44.783503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1db72-3500-4f4d-9593-e63ed0b4b461 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.804085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:44.852478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:44.853111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:44.853384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:44.853676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:44.857802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:44.859246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:44.871258 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 114/229] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:44.872504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:44.973824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707994a5-e193-41d9-82fe-7f6081eaaf6d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:44.978748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8cd09-4e1e-4f7e-935e-e3dc094f8be2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:45.015935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:45.016573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.016852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.017115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.018227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:45.019670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:45.026512 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 115/230] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:45.027996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:45.061418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:45.062466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.062929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.063399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.066084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:45.069310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:45.071346 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 116/231] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:44 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:45.079374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:45.105491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:45.187591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:45.206516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410556fa-b834-48f7-9285-a6d6d426713c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:45.217818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f495f-d814-4954-9b8e-6f324dabdb6c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:45.243176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:45.244190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.244655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.245157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.246520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:45.248289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:45.250596 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 117/232] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:45 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:45.259952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:45.262524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:45.263200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.263477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.263765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/88b80b43a4d14a8e825325315bf5a356/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.266335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, user_id=88b80b43a4d14a8e825325315bf5a356, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:45.267370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5453217-86f6-434e-8eee-841508ffd60e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:45.288860 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 116/233] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:45 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/88b80b43a4d14a8e825325315bf5a356/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:45.384533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0581b16-8713-46e2-8dcb-801133409fe6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:45.422533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:45.423215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.423485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.423769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/88b80b43a4d14a8e825325315bf5a356/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.426060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, user_id=88b80b43a4d14a8e825325315bf5a356, role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:45.427585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11d66-2bc5-494b-bc20-3bb0ab7fe4f2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:45.445883 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 118/234] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:45 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/88b80b43a4d14a8e825325315bf5a356/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:45.620733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c478-8e7d-4f9e-8bfc-6e92cb076a4a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.621350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c478-8e7d-4f9e-8bfc-6e92cb076a4a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.621822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c478-8e7d-4f9e-8bfc-6e92cb076a4a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.623684 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 117/235] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:45.629414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b066ac-4aa3-44be-92ea-fdb459637f93 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.629695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b066ac-4aa3-44be-92ea-fdb459637f93 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.629963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b066ac-4aa3-44be-92ea-fdb459637f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.652851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-59b066ac-4aa3-44be-92ea-fdb459637f93 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:45.654045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59b066ac-4aa3-44be-92ea-fdb459637f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:45.662554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:45.735685 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 119/236] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:45.797359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339594-c2b6-4aad-bd0e-42a3b1aac8b9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.798053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339594-c2b6-4aad-bd0e-42a3b1aac8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.798540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339594-c2b6-4aad-bd0e-42a3b1aac8b9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.800125 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 118/237] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:45.805557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:45.805835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:45.806101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:45.836736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:45.838077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:45.931490 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 120/238] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:46.179544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339594-c2b6-4aad-bd0e-42a3b1aac8b9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.294589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.305299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339594-c2b6-4aad-bd0e-42a3b1aac8b9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:46.316869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:46.343271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:46.344053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.344333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.344601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.356491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1ef1d228-ed31-4368-ab3c-e4ec1f3a4845 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:46.362643 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:46.363526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:46.364939 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 119/239] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:46.365608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6c1c-85a3-4d17-a03f-8e42f3cc9f91 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.365608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6c1c-85a3-4d17-a03f-8e42f3cc9f91 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.365917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6c1c-85a3-4d17-a03f-8e42f3cc9f91 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.367401 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 120/240] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:46.372452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6c1c-85a3-4d17-a03f-8e42f3cc9f91 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.418931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:46.454045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017d3bc-f6c5-4d43-9c31-db3638d725ec None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:46.481853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6c1c-85a3-4d17-a03f-8e42f3cc9f91 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:46.494193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:46.494856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.495163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.495436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.496897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:46.499200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6a7fa-7688-4136-bf13-c9d9151cd240 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:46.506083 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 121/241] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:46.506083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.506083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.506083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.527217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:46.528453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:46.528923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:46.529160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.529435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.529755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.530480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:46.530777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:46.532470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:46.550048 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 121/242] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:46.550048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.582646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:46.612210 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 122/243] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:46.613529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.672928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339d20-dbc0-429a-99d1-d34a8c322000 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:46.705221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:46.746441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:46.748985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.749465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.749968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.752158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:46.753835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:46.773579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a9ee-6894-4e38-9580-01d6cafe8309 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:46.808116 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 122/244] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:46 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:46.825121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:46.826127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:46.826626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:46.827084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] PATH_INFO: `/v3/users/916f9c01fc584402ac87889186b3cc9b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:46.842980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] RBAC: Authorizing `identity:get_user(user_id=916f9c01fc584402ac87889186b3cc9b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:46.844853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:46.847101 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 123/245] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/users/916f9c01fc584402ac87889186b3cc9b => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:46.853372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.908357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:46.989612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.028276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39e5d-d304-4147-8cfd-32e2a3ae54b3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.075476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.076785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.077717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.078325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.080413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b49de-392f-40f4-a201-0c7a6a324caf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.111520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.121154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.121941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.122316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.122681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.135852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:47.141933 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:47.143066 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:47.144146 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:47.145371 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 124/246] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:47.151080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.176207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.178240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.284841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c711d5-2374-472f-8620-7c86b6f4efb5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.286986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.321465 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 123/247] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:47.326915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.343865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.344492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.344902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.345071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.345781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:47.346082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.347536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.363829 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 125/248] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:47.366436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.439348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.457524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd075ea5-2dd0-43c0-abbb-b0d411cb16e4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.498253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.499263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.499763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.500286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.501707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.504128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.506018 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:47 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:47.510180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c5ed-c1fe-40b6-9c13-811a9314516d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.513001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.552292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.552940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.553213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.553480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] PATH_INFO: `/v3/users/18c4dead86294f9f8110583d61e1f4d7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.555027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] RBAC: Authorizing `identity:get_user(user_id=18c4dead86294f9f8110583d61e1f4d7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.557455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.560109 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 126/250] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:47 2022] GET /identity/v3/users/18c4dead86294f9f8110583d61e1f4d7 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:47.567908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.580698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.645115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3b1-e4d1-4873-b66d-58e3c0d18596 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.685218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.686221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.686743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.687208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.688222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=916f9c01fc584402ac87889186b3cc9b) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:47.688761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.690607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91600ff-ebc3-4a31-b85f-93f625e78311 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.697364 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 125/251] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:47 2022] GET /identity/v3/role_assignments?user.id=916f9c01fc584402ac87889186b3cc9b&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:47.698286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68299b-dda8-4cb7-ad93-c92f3e6bcba6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:47.699433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ecf0-813f-4fad-8efa-9bd918e57875 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.704146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ecf0-813f-4fad-8efa-9bd918e57875 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.704752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ecf0-813f-4fad-8efa-9bd918e57875 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.706420 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 126/252] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:47.712551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.713149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.713971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.719186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:47.739165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:47.739874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.740150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.740419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.740853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:47.741643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:47.742570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:47.743156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175554d-d6a9-468e-9230-14785a389f1c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:47.744937 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 127/253] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:47 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:47.748098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a534d-a892-41ce-9e11-c2e31fd6b622 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.748098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a534d-a892-41ce-9e11-c2e31fd6b622 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.748098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a534d-a892-41ce-9e11-c2e31fd6b622 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.750404 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 128/254] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:47.754889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063547f-4884-47db-94b2-440840f304f9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:47.755168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063547f-4884-47db-94b2-440840f304f9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:47.755437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063547f-4884-47db-94b2-440840f304f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:47.788921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5063547f-4884-47db-94b2-440840f304f9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:47.791204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5063547f-4884-47db-94b2-440840f304f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:47.869844 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 127/255] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:47.872135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:47.948862 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 129/256] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:47.960182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:48.014791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e957-b9ae-4941-8702-603554c8bd98 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:48.050155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:48.051182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:48.051681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:48.052190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/18c4dead86294f9f8110583d61e1f4d7/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:48.054297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, user_id=18c4dead86294f9f8110583d61e1f4d7, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:48.055979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:48.071561 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 128/257] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:47 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/18c4dead86294f9f8110583d61e1f4d7/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:48.203535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063547f-4884-47db-94b2-440840f304f9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.322241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063547f-4884-47db-94b2-440840f304f9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:48.340436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:48.359667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:48.360342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:48.360618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:48.360886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:48.372025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:48.377059 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:48.377953 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:48.378922 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 130/258] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:48.385828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.463686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.591877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f751f-bc5a-40df-a7c1-95760acc21c3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:48.597251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:48.621211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57784-4a45-4db6-b0db-0ba8950848fd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:48.685400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:48.686405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:48.687303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:48.687826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:48.705368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:48.705997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:48.706269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:48.706531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:48.707213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:48.707508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:48.708916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:48.711225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:48.717294 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:48.718190 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:55:48.719094 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:48.721740 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 131/259] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:48.728100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.738038 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 129/260] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:48.744741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.784116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:48.883222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e98585-1bfd-4d64-865c-22b41b13bf16 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:48.945133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:48.945753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:48.946028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:48.946299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:48.946976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:48.947275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:48.949088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:48.966325 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 132/261] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:48.972504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:48.998620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5224e6-a4bc-4e68-ad10-edb59693b9a2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:49.101194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:49.101863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:49.102138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:49.102402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:49.103570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:49.105174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:49.107199 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 130/262] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:49.116884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:49.141615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1732d-cb09-4a30-be42-1e975fa34e85 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:49.156119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:49.211139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:49.211817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:49.212096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:49.212263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:49.212428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] PATH_INFO: `/v3/users/88b80b43a4d14a8e825325315bf5a356` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:49.213481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] RBAC: Authorizing `identity:get_user(user_id=88b80b43a4d14a8e825325315bf5a356)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:49.215777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:49.221854 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 133/263] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:48 2022] GET /identity/v3/users/88b80b43a4d14a8e825325315bf5a356 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:49.229072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:49.349852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7519f7e-95df-4db6-bb6b-c607ff2935fc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:49.410924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71c5d1-8f01-438d-ada0-c8b6e83f649f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:49.416919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:49.418163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:49.418687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:49.419150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:49.501881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:49.502406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:49.502679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:49.502945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:49.514863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:49.516725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:49.560987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:49.561596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:49.644592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:49.646094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:49.675515 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 131/264] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:49.681629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:49.883690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd051e-5ea7-4101-b596-000bf62aabd4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:49.939700 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 134/265] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:49.945778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:49.976485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:49.977165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:49.977436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:49.977703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:49.978883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:49.981063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:49.983035 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 132/266] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:49 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:49.989424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:49.993081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:50.076638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:50.150882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf62c7a-0c49-4cc6-94c1-2f783957e50e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:50.198829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:50.199473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.199764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.200032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.204443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:50.205939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:50.207946 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 135/267] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:49 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:50.208823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d832-ea6c-44a3-bc77-775b06a36e79 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:50.213808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:50.273439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:50.274419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.274889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.275440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.276427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=88b80b43a4d14a8e825325315bf5a356) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:50.276961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:50.278648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64b0f5-5223-4204-bd22-8dcd6b9eb548 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:50.305707 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 133/268] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:49 2022] GET /identity/v3/role_assignments?user.id=88b80b43a4d14a8e825325315bf5a356&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:50.306996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30eb5-f5ff-49c6-8134-c5af5d1556e9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.307273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30eb5-f5ff-49c6-8134-c5af5d1556e9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.307623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30eb5-f5ff-49c6-8134-c5af5d1556e9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.309414 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 134/269] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:50.316858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b31f-eaf2-4dd4-bedb-d8484129a375 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.317145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b31f-eaf2-4dd4-bedb-d8484129a375 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.317395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b31f-eaf2-4dd4-bedb-d8484129a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.343507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7bf0e-d8b9-43ca-a26c-cde2089917f5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:50.353456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5f33b31f-eaf2-4dd4-bedb-d8484129a375 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:50.354816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5f33b31f-eaf2-4dd4-bedb-d8484129a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:50.406119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:50.406650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.406921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.407185 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.407952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=88b80b43a4d14a8e825325315bf5a356) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:50.408261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:50.409748 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0340b9-eb59-452a-a5df-960e6dbb11e6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:50.411879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:50.421636 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 136/270] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:50 2022] GET /identity/v3/role_assignments?user.id=88b80b43a4d14a8e825325315bf5a356&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:50.422976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca07-5282-45ec-b473-0ecb48c38d27 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.423260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca07-5282-45ec-b473-0ecb48c38d27 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.423530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca07-5282-45ec-b473-0ecb48c38d27 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.427782 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 137/271] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:50.432048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0e21-a3b5-4cd4-83f3-fcf63c6e1d0d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.432048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0e21-a3b5-4cd4-83f3-fcf63c6e1d0d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.432048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0e21-a3b5-4cd4-83f3-fcf63c6e1d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.454627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a21c0e21-a3b5-4cd4-83f3-fcf63c6e1d0d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:50.454627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a21c0e21-a3b5-4cd4-83f3-fcf63c6e1d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:50.479296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:50.505828 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 135/272] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:50.540003 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 138/273] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:50.556820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156249dd-a001-4c77-868e-3327f0d95cc9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.557501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156249dd-a001-4c77-868e-3327f0d95cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.558218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156249dd-a001-4c77-868e-3327f0d95cc9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.565082 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 136/274] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:50.570720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6789b-53ba-4c62-aadf-19701f083604 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.571008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6789b-53ba-4c62-aadf-19701f083604 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.571262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6789b-53ba-4c62-aadf-19701f083604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.596572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-44a6789b-53ba-4c62-aadf-19701f083604 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:50.597760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-44a6789b-53ba-4c62-aadf-19701f083604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:50.687985 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 139/275] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:50.835647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156249dd-a001-4c77-868e-3327f0d95cc9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:50.879383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be096ea-57d6-4ba8-82b4-fd60559b1293 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.880148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be096ea-57d6-4ba8-82b4-fd60559b1293 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.880624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be096ea-57d6-4ba8-82b4-fd60559b1293 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.882430 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 140/276] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:50.887891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:50.888446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:50.888958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:50.917698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:50.919246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:50.971600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156249dd-a001-4c77-868e-3327f0d95cc9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:50.998924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.006371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.007011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.007283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.007560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.013142 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 141/277] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:51.014057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.017983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:51.022758 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:51.023845 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 137/278] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:51.024746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.082546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.127696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518418d1-49eb-4259-a3a9-84aeb6d0be92 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.129004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c116dc-4857-4ef2-a2ad-1cf72ac03c96 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.164555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.164964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.165194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.165470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.165623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.165770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.165867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.166123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.168198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.169669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.171238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 142/279] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.172008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.182789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:51.187945 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:51.188964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 138/280] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:51.191189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.243166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.297577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a157-bf86-49bb-868d-798cbaeb4539 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.298902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf214-5cbb-44c7-84b8-2ed007e4bab6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.314275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.332303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.332800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.332936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.333165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.333406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.333505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.333686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.333949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.334045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.334617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:51.334916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.335488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.336357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.344717 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.345511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.359544 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 139/282] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:55:51 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:51.360608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.461335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3b7c-d5ee-4fa3-b735-c9dead7fb0e1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.481027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.483573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5f27-b8ee-464c-92f8-3b1627623e0c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.503464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.504046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.504324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.504595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.505277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:51.505581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.507538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.517234 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.518068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.526522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.527173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.527457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.527728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.542163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:51.547779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:51.548852 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:51.549748 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:51.551308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.596670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.651061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474f4-b6df-4057-bde7-fb9aa533e36c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.688422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1360-9ee0-4357-ab79-0188e29a3c73 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.690222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.690896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.691171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.691441 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] PATH_INFO: `/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.708948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] RBAC: Authorizing `identity:get_user(user_id=6089c8afc2a14dcfa0634b1ec11c34f2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.710959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.713460 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.714404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.729663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.730306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.730581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.730960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] PATH_INFO: `/v3/users/916f9c01fc584402ac87889186b3cc9b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.732176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=916f9c01fc584402ac87889186b3cc9b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.733636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.735226 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 141/286] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/users/916f9c01fc584402ac87889186b3cc9b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.740471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.759165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.827772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074ec8-3ac4-496d-9141-d2f0f179fb23 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.866026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.866979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.867466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.867996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.868946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:51.869451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.871413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.872206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:51.876443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3e33-d76c-4918-8085-9273d7bc7dc3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:51.887236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.888629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:51.919047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:51.919671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:51.919969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:51.920243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:51.921228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, user.id=6089c8afc2a14dcfa0634b1ec11c34f2, scope.system=all) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:51.921532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:51.923717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:51.931097 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/role_assignments?user.id=6089c8afc2a14dcfa0634b1ec11c34f2&scope.system=all&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:51.931946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:52.067230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:52.072843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a242e9-0fe1-42fb-825a-b3d0d53d9b63 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.078900 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3777d99-bac6-4c24-86b1-795bc27a3738 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.137394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.139039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.139807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.140284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] PATH_INFO: `/v3/users/18c4dead86294f9f8110583d61e1f4d7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.141664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] RBAC: Authorizing `identity:get_user(user_id=18c4dead86294f9f8110583d61e1f4d7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.143399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.143672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.144109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.144385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.144651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.145768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.146453 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 143/289] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/users/18c4dead86294f9f8110583d61e1f4d7 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:52.148635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.154408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:52.155665 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 147/290] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:51 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:52.160555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:52.228117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:52.311173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b55f-4e0d-41c5-9c49-51632de84f73 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.355155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.355805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.356089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.356362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/916f9c01fc584402ac87889186b3cc9b/roles/260631726dc04ce6bd3c1b6d7d8a906f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.359484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, user_id=916f9c01fc584402ac87889186b3cc9b, role_id=260631726dc04ce6bd3c1b6d7d8a906f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.360980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.376177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ec1d-24c8-4c31-92a4-66a3ff64685b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.384117 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 148/291] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:55:52 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/users/916f9c01fc584402ac87889186b3cc9b/roles/260631726dc04ce6bd3c1b6d7d8a906f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:52.424420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.425100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.425373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.425635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.499363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.500864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.532409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:52.616655 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 144/292] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:52.622805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:52.660908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:52.761241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d824d-659b-4e39-9577-420793264930 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.799898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.800588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.800861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.801123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.802255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.803694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7f28a-2e68-4f9b-9bef-225fdba40b7b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.805677 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 149/293] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:52 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:52.811468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:52.918298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541c71-6010-46cc-8f5c-9ea3a80001c0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:52.947960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:52.953969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:52.954591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:52.954867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:52.955138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:52.955990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=18c4dead86294f9f8110583d61e1f4d7) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:52.956459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:52.958252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed1176-219a-433b-9141-e69652f3a8df None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:52.967936 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 145/294] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:52 2022] GET /identity/v3/role_assignments?user.id=18c4dead86294f9f8110583d61e1f4d7&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:53.586488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff77b-6d46-48f8-8ca0-a95f5de2c2d8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:53.586978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff77b-6d46-48f8-8ca0-a95f5de2c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:53.586978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff77b-6d46-48f8-8ca0-a95f5de2c2d8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:53.588607 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 150/295] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:53.595406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee0cd-1187-4f1e-abdb-53885d1692b1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:53.595923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee0cd-1187-4f1e-abdb-53885d1692b1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:53.596001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee0cd-1187-4f1e-abdb-53885d1692b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:53.616286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a95ee0cd-1187-4f1e-abdb-53885d1692b1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:53.617472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a95ee0cd-1187-4f1e-abdb-53885d1692b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:53.698932 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 146/296] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:53.724085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c964-9860-4355-b17d-5cf7e5424db1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:53.724392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c964-9860-4355-b17d-5cf7e5424db1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:53.724634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1c964-9860-4355-b17d-5cf7e5424db1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:53.726242 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 151/297] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:53.731692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:53.732021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:53.732294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:53.750531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:53.751718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:53.819257 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 147/298] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:53.971677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1c964-9860-4355-b17d-5cf7e5424db1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.072743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.080105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1c964-9860-4355-b17d-5cf7e5424db1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.089575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.115592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.116289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.116573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.116836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.127719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:54.132702 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:54.133623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:54.134438 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 152/299] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:54.141141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.157198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.202981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3332bb1-d76d-4ccb-9d77-3ece59fd794e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.241111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.241671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.241938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.242221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.243401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:54.244925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc9f72-a67b-441d-b1be-f751b72c3d19 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:54.246691 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 148/300] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:54.247429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf939-2306-4681-98ee-25a8797b137a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.247600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912fd4-556e-435d-a192-bf4d048b5146 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.247909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912fd4-556e-435d-a192-bf4d048b5146 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.248176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912fd4-556e-435d-a192-bf4d048b5146 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.249515 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 149/301] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:54.251823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912fd4-556e-435d-a192-bf4d048b5146 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.282096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.282706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.282982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.283249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.283947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:54.284446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:54.285639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d1fcf-b219-4380-bde1-a3dc9ec27c51 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:54.295105 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 153/302] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:54.296393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.296673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.296941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.315321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:54.316547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:54.330883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.377186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912fd4-556e-435d-a192-bf4d048b5146 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.395840 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 154/303] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:54.395840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.403453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.415395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.416269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.417226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.417602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] PATH_INFO: `/v3/groups` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.418414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:54.420112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:54.440671 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 150/304] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Aug 21 00:55:54 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:55:54.513770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa9c7c-c2c7-426c-b483-59079e68475c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.553757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.554495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.554770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.555037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] PATH_INFO: `/v3/users/cd057023e70240eea7cf96d3aa545ea8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.571210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cd057023e70240eea7cf96d3aa545ea8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:54.572759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:54.575043 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 155/305] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/users/cd057023e70240eea7cf96d3aa545ea8 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:54.581083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.665625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.676800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.693677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a7233-27c4-44bd-882d-42a4fc62c9ce None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.739476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.740128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.740403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.740671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.741463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, user.id=cd057023e70240eea7cf96d3aa545ea8, scope.system=all) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:54.741769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:54.743200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5c15b-3b64-4672-92ff-55c2f7bec883 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:54.748855 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 151/306] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/role_assignments?user.id=cd057023e70240eea7cf96d3aa545ea8&scope.system=all&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:54.752466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc49c3-aaa8-4c9c-a8d6-2be81e2ac60f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.752745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc49c3-aaa8-4c9c-a8d6-2be81e2ac60f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.753012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc49c3-aaa8-4c9c-a8d6-2be81e2ac60f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.754495 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 152/307] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:54.760963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.761282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.761503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.785399 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:54.786700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:54.800961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057e445-9c7c-4d62-a0a2-f71fa3b023a8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:54.840737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:54.841439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:54.841707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.842772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:54.843259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:54.859606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:54.865237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:54.866251 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:54.867037 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:54.869260 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 156/308] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:54.873600 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 153/309] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:54.875335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:54.949373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:54.986528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ad56b-717f-4c87-a4b9-20b592427bad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.023579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.024555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.024967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.025371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.026283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:55.026723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.028285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.037765 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 157/310] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:55.044931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.145896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fd3dc-20e1-4d4f-bcd0-b8ccfb9dd817 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.155203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.187129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.187788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.188063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.188382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] PATH_INFO: `/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.189563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] RBAC: Authorizing `identity:get_user(user_id=6089c8afc2a14dcfa0634b1ec11c34f2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.191079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.192842 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 154/311] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:55 2022] GET /identity/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:55.198256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.246486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:55.267598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e4d28-2863-4a65-a2aa-182bb9577ad4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.296046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:55.305409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.306328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.306796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.307252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.313363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eefaa6-4ca3-4865-b74a-235acecc7943 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.319676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:55.326700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:55.328258 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:55.329726 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:55.332531 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 158/312] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:55.337833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.355886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.356588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.356874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.357146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] PATH_INFO: `/v3/system/users/6089c8afc2a14dcfa0634b1ec11c34f2/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.358554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6089c8afc2a14dcfa0634b1ec11c34f2, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.359995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.375829 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 155/313] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Aug 21 00:55:55 2022] PUT /identity/v3/system/users/6089c8afc2a14dcfa0634b1ec11c34f2/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:55:55.464026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a36e7-d632-43c7-bc24-b20af5a6403d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.506131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.506749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.507025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.507288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.507994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:55.508290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.509700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.520238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:55.525957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.636236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695660ed-789b-4df6-b6a4-e8b5267db08b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.647599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:55.672623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.673272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.673546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.673815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] PATH_INFO: `/v3/users/916f9c01fc584402ac87889186b3cc9b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.675010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] RBAC: Authorizing `identity:get_user(user_id=916f9c01fc584402ac87889186b3cc9b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.676618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.678624 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 156/315] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:55 2022] GET /identity/v3/users/916f9c01fc584402ac87889186b3cc9b => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:55.685266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:55.738899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:55.791096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aec52d-dea2-4b89-811a-ddc96a2c6648 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:55.827073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:55.828142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:55.828611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:55.829068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:55.902861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:55.904724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:55.955150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:56.006747 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:55:56.012746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:56.117336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc543-9cb4-4649-a558-f441bcfd26e7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:56.151856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:56.152503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.152779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.153102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.154176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:56.155617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c831f-35f4-4830-ae6c-81cb6fc6efae None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:56.157593 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:55:56 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:56.163473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:56.264210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf2016-0eb1-4def-8bba-ca5fa3ce6d2b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:56.310071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:56.311067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.311548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.312067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.312981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2, user.id=916f9c01fc584402ac87889186b3cc9b) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:56.313473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:56.315125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f553eb-52c7-4ea0-886f-deef1ed0f7a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:56.322166 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 161/318] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:55:56 2022] GET /identity/v3/role_assignments?user.id=916f9c01fc584402ac87889186b3cc9b&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:56.558892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5568f6-05d7-40e9-9e88-c9e404a3b1fd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.559234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5568f6-05d7-40e9-9e88-c9e404a3b1fd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.559403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5568f6-05d7-40e9-9e88-c9e404a3b1fd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.560876 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:56.565997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d316c5-ccfc-4830-8fd5-d6362fc1e9c1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.566281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d316c5-ccfc-4830-8fd5-d6362fc1e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.566551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d316c5-ccfc-4830-8fd5-d6362fc1e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.585092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-96d316c5-ccfc-4830-8fd5-d6362fc1e9c1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:56.586252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-96d316c5-ccfc-4830-8fd5-d6362fc1e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:56.596252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:56.662309 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:56.708750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f68-2650-482b-957f-a8fe0fd89980 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.709105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f68-2650-482b-957f-a8fe0fd89980 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.709440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f68-2650-482b-957f-a8fe0fd89980 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.711052 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 159/321] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:56.716443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:56.716915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:56.716988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:56.735891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:56.737059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:56.809590 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:55:56.949271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0f68-2650-482b-957f-a8fe0fd89980 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.000702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:57.059067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0f68-2650-482b-957f-a8fe0fd89980 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.086497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.093797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.094429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.094699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.094962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.096600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:57.098542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:57.103800 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 160/323] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:57.106944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.169612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:57.197678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e1a97-1c6c-4ced-a236-d69ffc7ecb31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.220301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18bbca-088c-4715-843d-3bc9dd8be228 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.234915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:57.239382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.240045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.240317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.240581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.251445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:57.256391 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:57.257281 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:55:57.258081 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:55:57.258692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.258692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.258692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.258903 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 164/324] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:55:57.262645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] PATH_INFO: `/v3/groups` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.263313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:57.263423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.264782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521c0c0-259d-48b0-8ced-d2690f8d79c9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:57.294620 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 161/325] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Aug 21 00:55:57 2022] POST /identity/v3/groups => generated 226 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:55:57.333418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9393-a504-41b6-97ce-01e7d0c6c5b4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.333750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9393-a504-41b6-97ce-01e7d0c6c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.334015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9393-a504-41b6-97ce-01e7d0c6c5b4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.335603 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 162/326] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:55:57.342781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196693f-312d-4f5f-a281-8703c093880e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.342983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196693f-312d-4f5f-a281-8703c093880e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.343208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196693f-312d-4f5f-a281-8703c093880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.362724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e196693f-312d-4f5f-a281-8703c093880e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:57.364133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e196693f-312d-4f5f-a281-8703c093880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:57.397672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14f28-27c8-4f18-a01d-91147032ff31 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.437748 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 163/327] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:55:57.439203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.439203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.439417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.439635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.440338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:57.440633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:57.442012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:57.444342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:57.454327 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 165/328] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:57.459945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196693f-312d-4f5f-a281-8703c093880e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.562505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196693f-312d-4f5f-a281-8703c093880e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.565294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:57.600484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.601142 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.601489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.601831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] PATH_INFO: `/v3/users/cd057023e70240eea7cf96d3aa545ea8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.603043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] RBAC: Authorizing `identity:get_user(user_id=cd057023e70240eea7cf96d3aa545ea8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:57.604777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:57.607055 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 164/329] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:57 2022] GET /identity/v3/users/cd057023e70240eea7cf96d3aa545ea8 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:57.612413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.710508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.720868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99bbb-784c-4b24-b1ad-3564ea3afc7e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.760448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.761146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.761423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.761690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] PATH_INFO: `/v3/system/users/cd057023e70240eea7cf96d3aa545ea8/roles/260631726dc04ce6bd3c1b6d7d8a906f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.763725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd057023e70240eea7cf96d3aa545ea8, role_id=260631726dc04ce6bd3c1b6d7d8a906f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:57.765637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:57.778479 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 166/330] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Aug 21 00:55:57 2022] PUT /identity/v3/system/users/cd057023e70240eea7cf96d3aa545ea8/roles/260631726dc04ce6bd3c1b6d7d8a906f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:55:57.846406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257c5a6-c0f2-40d4-ad46-eaed597ea115 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:57.886980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:57.887647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:57.887964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:57.888232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:57.900378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:55:57.905692 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:55:57.906676 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:55:57.907516 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 165/331] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:55:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:55:57.913840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:57.983814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:58.029238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93db7-8f13-400d-a0c9-facb26ba952a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:58.069771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:58.070772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:58.071236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:58.071708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:58.072658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:58.073219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:58.075219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:58.085597 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 167/332] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:55:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:58.092872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:58.129631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:58.212646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ca6c-f467-4a3e-beca-fc2c80d1b0ad None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:58.253970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:58.254696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:58.254974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:58.255243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] PATH_INFO: `/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:58.256531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] RBAC: Authorizing `identity:get_user(user_id=6089c8afc2a14dcfa0634b1ec11c34f2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:58.258056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591edbc-781a-4135-b131-b8565a91e12a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:58.259652 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 166/333] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:55:58 2022] GET /identity/v3/users/6089c8afc2a14dcfa0634b1ec11c34f2 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:58.268457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:55:58.393569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c009c6-5565-40c1-b38e-8ee0e17020a5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:55:58.416327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:58.431694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:55:58.432389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:58.432703 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:58.432969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:58.433708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] RBAC: Adding query filter params (role.id=b3fbac766b24473a8e72d9b338bc8722, user.id=6089c8afc2a14dcfa0634b1ec11c34f2, scope.system=all) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:55:58.434008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:55:58.435470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cfafd-31b4-4874-8142-b9246f814784 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:55:58.447512 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 168/334] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Aug 21 00:55:58 2022] GET /identity/v3/role_assignments?user.id=6089c8afc2a14dcfa0634b1ec11c34f2&scope.system=all&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:55:59.789941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f455b5a-3709-4731-b924-a71a673b03cb None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:59.790506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f455b5a-3709-4731-b924-a71a673b03cb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:59.790506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f455b5a-3709-4731-b924-a71a673b03cb None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:59.792484 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 167/335] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:55:59.799302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f19849-4e85-4f8c-93e9-97801272909a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:55:59.799812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f19849-4e85-4f8c-93e9-97801272909a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:55:59.799913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f19849-4e85-4f8c-93e9-97801272909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:55:59.820672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-15f19849-4e85-4f8c-93e9-97801272909a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:55:59.821860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-15f19849-4e85-4f8c-93e9-97801272909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:55:59.912947 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 169/336] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:00.182233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f44c6-49df-450e-97dc-a745d266cb89 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.182563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f44c6-49df-450e-97dc-a745d266cb89 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.182880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f44c6-49df-450e-97dc-a745d266cb89 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.184600 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 168/337] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:00.189826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10e87-5547-4b7a-b120-d78694677933 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.190113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10e87-5547-4b7a-b120-d78694677933 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.190389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10e87-5547-4b7a-b120-d78694677933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.216845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-05d10e87-5547-4b7a-b120-d78694677933 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:00.218075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-05d10e87-5547-4b7a-b120-d78694677933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:00.305707 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:00.345611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f44c6-49df-450e-97dc-a745d266cb89 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:00.388304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe84d-708a-4092-8982-e301907e9219 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.388699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe84d-708a-4092-8982-e301907e9219 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.388864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe84d-708a-4092-8982-e301907e9219 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.390475 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 171/339] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:00.408745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22fe2-388b-4dbc-94a1-bb97bb419eef None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.409053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22fe2-388b-4dbc-94a1-bb97bb419eef None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.409297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22fe2-388b-4dbc-94a1-bb97bb419eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.449306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8ab22fe2-388b-4dbc-94a1-bb97bb419eef None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:00.450439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8ab22fe2-388b-4dbc-94a1-bb97bb419eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:00.496137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:00.500400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f44c6-49df-450e-97dc-a745d266cb89 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:00.530581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:00.565852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:00.567075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.567541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.568132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.589817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:00.595105 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:00.596007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:00.596801 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:00.599577 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 169/340] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:00.605420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:00.622372 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 172/341] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:00.708332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466b0e-8112-49da-86cc-ee40f159762d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.708940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466b0e-8112-49da-86cc-ee40f159762d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.709397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466b0e-8112-49da-86cc-ee40f159762d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.712003 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 173/342] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:00.716457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.716732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.716999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.748787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:00.750790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:00.827596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016826-2e9f-41d5-84f9-34d9459572ff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:00.872608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:00.873659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:00.874182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:00.874650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:00.875610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:00.876167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:00.877812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:00.878439 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 174/343] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:00.881190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:00.890949 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 170/344] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:00.904592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:00.942812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.024984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.035912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd65f1-f444-4a53-8bab-03e27836d92a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.059378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fe526-2987-4451-ae06-1205b9c97335 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.090946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.091595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.091907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.092335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.102959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.104658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.105142 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.105601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.107969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:01.112840 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:01.113790 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:56:01.114599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:01.120306 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 175/345] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:01.121369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.187785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.189834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.221798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.279874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4740a-ff8f-4da1-8e33-b0ae034b6220 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.308402 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 171/346] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:01.309591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.339454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.340469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.340925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.341366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.356767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:01.361884 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:01.362822 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:01.363728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:01.370254 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 176/347] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:01.371509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.409939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.435801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7594a4-e973-4596-b8d1-879fda77af7e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.469551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.486629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.487376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.487716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.488604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.489441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:01.489810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.492051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.505167 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 172/348] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:01.505831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.520913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322e7a-220a-4101-b653-3a931c403d6d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.563764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.564340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.564614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.564955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.566551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.568070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd3465-e45d-48c7-89f4-289d45678f63 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.569862 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 177/349] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:01.570999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42559f80-6752-48a5-ae9b-002d543a564e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.571250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42559f80-6752-48a5-ae9b-002d543a564e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.571528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42559f80-6752-48a5-ae9b-002d543a564e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.575645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 178/350] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:01.576491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42559f80-6752-48a5-ae9b-002d543a564e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.628990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f4cb-d89a-4342-a95e-0faf9b985a74 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.673729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.674606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.674877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.675141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.675866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:01.676307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.678322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.683680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.691871 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 173/351] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:01.693299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.704246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42559f80-6752-48a5-ae9b-002d543a564e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.746301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.747109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.747389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.747658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.750015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.759424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:01.764862 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:01.765783 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:01.766599 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 179/352] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:01.767277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.826184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1b43-f182-4bbf-9125-3057def8cfc7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.865806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.866445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.866706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.866974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] PATH_INFO: `/v3/users/cd057023e70240eea7cf96d3aa545ea8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.868127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] RBAC: Authorizing `identity:get_user(user_id=cd057023e70240eea7cf96d3aa545ea8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.869584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970484df-10c1-4f87-b669-76a3c5683d2a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.871386 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 174/353] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/users/cd057023e70240eea7cf96d3aa545ea8 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:01.873759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.874037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.874302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.895624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:01.896905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:01.905048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a1f5-e070-4442-9909-be7aab7297a8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:01.948530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:01.949185 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:01.949470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:01.949730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:01.959093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:01.960865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:01.962711 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 180/354] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:01.963467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:01.984662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:01.990563 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 175/355] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:01.995798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.050612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.094134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199748-7440-4e7b-8d87-cd9b8e0694a0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.110130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315574-2ec9-4c11-87ed-aabb765c7429 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.129586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.130206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.130483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.130753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.146383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.146990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.147259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.147521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.148216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:02.148508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.149893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.159953 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 176/356] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:02.160821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.207990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.209480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.225548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.269633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b560a-6166-48d1-a364-6b4d1c7548ab None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.281673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.318497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.319114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.319387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.319654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.320883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] RBAC: Adding query filter params (role.id=260631726dc04ce6bd3c1b6d7d8a906f, user.id=cd057023e70240eea7cf96d3aa545ea8, scope.system=all) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:02.320883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.322197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.335416 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 181/357] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:02.335958 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 177/358] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/role_assignments?user.id=cd057023e70240eea7cf96d3aa545ea8&scope.system=all&role.id=260631726dc04ce6bd3c1b6d7d8a906f => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:02.336724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.340657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.456138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679bf0-b0ed-494c-a4ee-5c06fff07f7b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.473225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9772b-ad0c-45c2-9b7d-03754923955d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.474203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.505598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.506222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.506497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.506766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.507533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:02.507931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.510093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a7bd-73cd-46cb-87b6-ab0ccaf325b8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.518596 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 182/359] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:02.519658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.520151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de9d8-d6bf-4607-92ad-7f4470f32a5a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.520430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de9d8-d6bf-4607-92ad-7f4470f32a5a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.520698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de9d8-d6bf-4607-92ad-7f4470f32a5a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.520964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.521377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.521782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.521976 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 183/360] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:02.523260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de9d8-d6bf-4607-92ad-7f4470f32a5a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.569134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.623177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.624758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc1d0-f342-465b-928a-9cf2c9b790d6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.664504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de9d8-d6bf-4607-92ad-7f4470f32a5a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.709633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.710203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.710477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.710750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.727419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:02.733130 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:02.734098 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:02.735158 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 184/361] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:02.736142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.753660 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 178/362] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:02.753951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.754454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.754454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.775839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:02.778670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:02.797859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.862176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:02.872751 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 179/363] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:02.873475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:02.876209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91f3a-063a-48be-b2cf-8af97a68b0b3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:02.918419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:02.919992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:02.920502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:02.920986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:02.922327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:02.924158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:02.926131 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 185/364] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:02.927138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.000218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d714ea-7f3d-4b5d-bba8-b96a63c94520 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.036456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.037071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.037340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.037601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.038263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:03.038556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.039940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.046236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980820-bf9a-4dba-80fb-6397458fa123 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.048663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.049392 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 180/365] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.050356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.084157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.085151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.085576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.085984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.087266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.088985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.091807 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 186/366] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:02 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.092809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.126835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.160725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832370d8-9989-4b5d-bdf9-3770d0a718ba None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.198140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.199135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.199509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.199815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.201061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.202500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.202996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff617-7c43-4ed9-807c-92390067fc16 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.204495 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 181/367] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.205386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.239227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.239882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.240159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.240428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.295345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.338021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.338468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3725-4152-47a1-aea3-2877066307e6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.339704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.369468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.383358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.385090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.385383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.385635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.386864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.390308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.391413 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 182/368] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.395864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.463005 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 187/369] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:03.464425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.538032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89723073-adc2-4cb2-897a-e73da70fe5c2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.548816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.582726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e54a3-84eb-476d-b329-2d26cfedb43e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.585757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.586375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.586640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.586913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.587639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:03.588009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.589665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.595724 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 183/370] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.596486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.625189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.625851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.626123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.626386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.639600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:03.644478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:03.645399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:03.646203 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 188/371] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:03.646894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.662713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.714029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e240d7-50bb-4628-b19a-9a991b07b07a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.755416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.756170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.756595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.756872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.757622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:03.757931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.759429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2c762-a147-4d40-9652-11452952c37a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.759559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.766742 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 184/372] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.767665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.799001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.820530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.821183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.821454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.821717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.822941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.824476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.826428 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 189/373] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.832744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:03.885724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e211-6e33-4504-9662-d680f9e7ac20 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:03.912147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:03.926342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:03.926981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:03.927261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:03.927535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:03.928432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:03.928742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:03.930304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:03.941214 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 185/374] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:03.948905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.049466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ca54-ff47-4c16-bbeb-153b959a8c6d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:04.111553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:04.112528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.112806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.113077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.114081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6996-2b55-48b3-9d4d-b456e9d335f8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:04.116252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:04.118570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:04.124535 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 190/375] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:04.130482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.189438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:04.190075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.190354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.190626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.221719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:04.266432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c226-1e1b-49b3-942f-8c893bb4a728 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:04.281300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:04.318806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:04.320227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:04.340116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:04.340737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.341010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.341277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.342012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:04.342314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:04.346739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:04.362037 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 191/376] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:04 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:04.472839 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 186/377] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:04.478547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.602061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909368-fbee-4e94-a891-de92380bc8cd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:04.631962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:04.638933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:04.639576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.639872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.640138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] PATH_INFO: `/v3/projects/977498717dcb4d37929af17aaaa0285d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.641326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=977498717dcb4d37929af17aaaa0285d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:04.642761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51240a32-214f-4015-9a3d-4f92ad61cbb2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:04.644419 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 192/378] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:04 2022] GET /identity/v3/projects/977498717dcb4d37929af17aaaa0285d => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:04.650409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.759410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:04.781466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef52-9a99-41be-8e17-4890d047e355 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:04.808783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ca3a-7e04-489e-8d10-8f371f59d250 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.809131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ca3a-7e04-489e-8d10-8f371f59d250 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.809335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ca3a-7e04-489e-8d10-8f371f59d250 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.812875 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 193/379] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:04.817202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.817481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.817754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.821776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:04.822421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.822699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.823032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] PATH_INFO: `/v3/groups/89d8b7e583194652ad4a91e845cbb9bc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.829250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] RBAC: Authorizing `identity:get_group(group_id=89d8b7e583194652ad4a91e845cbb9bc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:04.830868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:04.832820 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 187/380] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:04 2022] GET /identity/v3/groups/89d8b7e583194652ad4a91e845cbb9bc => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:04.848516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.855835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:04.856993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:04.964361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b0f-2884-41c5-b641-a1a6ce1cfb94 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.008117 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 194/381] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:05.009454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.010093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.010410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.010683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.011428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] RBAC: Adding query filter params (group.id=89d8b7e583194652ad4a91e845cbb9bc, role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=977498717dcb4d37929af17aaaa0285d) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:05.011752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.013233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.019766 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 188/382] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:04 2022] GET /identity/v3/role_assignments?group.id=89d8b7e583194652ad4a91e845cbb9bc&scope.project.id=977498717dcb4d37929af17aaaa0285d&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:05.436745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:05.565884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b582401-78aa-444e-a7a5-fb8aaa97c236 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.597575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:05.605478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.606129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.606408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.606677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.619275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:05.624398 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:05.625292 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:05.626108 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:05.630406 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 195/383] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:05.631802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:05.646576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:05.755451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686741-1359-4e46-b6c0-757e362eb064 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.802626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.803249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.803527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.803830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.804510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:05.804810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.806178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.819468 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 189/384] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:05.825400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:05.935588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976569-8ae8-4120-a59e-22c77a3e965a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.971607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.972288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.972566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.972841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.973956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.975446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501050-aee2-4b0a-9957-334498cd6aad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.977064 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 196/385] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:05 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:05.983198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:06.086675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:06.129930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84315e-1d39-46e3-939e-32a21e9b0cad None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:06.140591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ede1-8319-4766-802b-ec7d4b376947 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.140867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ede1-8319-4766-802b-ec7d4b376947 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.141300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4ede1-8319-4766-802b-ec7d4b376947 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.143089 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 197/386] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:06.147569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65237fc-082b-4516-879c-bb91e23b6870 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.148173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65237fc-082b-4516-879c-bb91e23b6870 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.148681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65237fc-082b-4516-879c-bb91e23b6870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.174846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a65237fc-082b-4516-879c-bb91e23b6870 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:06.179235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a65237fc-082b-4516-879c-bb91e23b6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:06.203637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:06.204688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.205356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.206519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.208046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:06.211114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:06.218590 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 190/387] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:05 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:06.220615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:06.302631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:06.330911 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 198/388] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:06.375446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1bfd-dc82-47f7-ae6c-846e150b1951 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:06.410381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:06.411057 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.411333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.411604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/groups/c56847dc8db342c49af49c90beb67573/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.413575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, group_id=c56847dc8db342c49af49c90beb67573, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:06.415012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:06.428226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:06.440205 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 191/389] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Aug 21 00:56:06 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/groups/c56847dc8db342c49af49c90beb67573/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:06.670471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3fcbe-5bbe-4638-9f34-700c3fbba451 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.671549 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3fcbe-5bbe-4638-9f34-700c3fbba451 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.672061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3fcbe-5bbe-4638-9f34-700c3fbba451 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.673926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:06.674069 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 199/390] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:06.680042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.680326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.680601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.702821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:06.704593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:06.781155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d041-aaf0-4b42-9df3-91c11d4f0e85 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:06.822549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:06.823806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.824358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.824827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.835808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:06.841069 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 200/391] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dd6038a5-96a3-4fbf-bff4-b365cacd5fe8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:06.842493 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:06.843538 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:06.844826 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:06.846019 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 192/392] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:06.851537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:06.855367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd923-e030-4040-9864-6329ba886a0d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.855645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd923-e030-4040-9864-6329ba886a0d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.855946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd923-e030-4040-9864-6329ba886a0d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.857398 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 193/393] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:06.863958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:06.864466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:06.864953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:06.899157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:06.902511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:07.014883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.036543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90340-7b73-43a7-af0f-a7766b52c93b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.045877 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 194/394] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:07.055770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.073704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.074324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.074603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.074873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.075554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:07.075890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.077291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.086277 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 201/395] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:07.091515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.150641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.252040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce388-562a-42ed-a221-d740cb5f5420 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.299787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.300454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.300733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.300994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.305229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.306805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.312697 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 195/396] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:07.314973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.337523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909b17-73ef-4adb-ab64-771daaf9c0a0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.384444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.385928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.386781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.387244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.401265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:07.403638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:07.411072 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:07.412011 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:07.412800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:07.415774 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 202/397] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:07.417432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.455880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790cd5-192a-449f-8ffe-da685ab330eb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.467046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.497106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.497745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.498016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.498281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.499408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.500899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.502691 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 196/398] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:07.503269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.540330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b8d60-a6b8-4a37-9fb8-8f858b1f7129 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.575474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.576131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.576408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.576675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.587586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-98492814-41e1-48cd-b9cc-9d2b54e53fae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:07.593488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:07.594430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:07.595238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 203/399] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:07.596459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731b24-53c8-403f-84be-fc3d8194b91c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.596557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731b24-53c8-403f-84be-fc3d8194b91c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.597110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731b24-53c8-403f-84be-fc3d8194b91c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.600169 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 204/400] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:07.600169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731b24-53c8-403f-84be-fc3d8194b91c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.615105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa72-3393-44ae-945f-f1f3b5537071 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.640862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.649989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.650609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.650928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.651187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.651886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:07.652195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.653575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.662619 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 197/401] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:07.663596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.704299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:07.709619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731b24-53c8-403f-84be-fc3d8194b91c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.748286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.749274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.749738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.750328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/groups/c56847dc8db342c49af49c90beb67573/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.752618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ab916068b43f4995ee1de5a3b90b8, group_id=c56847dc8db342c49af49c90beb67573, role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.754217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d93fb9-ef0c-4800-a078-5add68ce0dc1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.775786 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 205/402] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Aug 21 00:56:07 2022] PUT /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8/groups/c56847dc8db342c49af49c90beb67573/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:07.775786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.775786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.775786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.789734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:07.790686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51b31-5164-4ea6-a0f5-08f63cbcbcea None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:07.790957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:07.838900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:07.840893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:07.841202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:07.841474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:07.842423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:07.842736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:07.844280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:07.857247 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:07.858236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.879458 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 206/404] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:07.880586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:07.951068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.011578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31163-5106-4ac6-8a37-23ccc8547ac2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.014188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.030917 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d2d4-5ae4-4c59-9671-ca6598998f5b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.055975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.056521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.056800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.057073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.058796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.060807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.063136 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 199/405] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:08.068599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.071077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.071715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.072015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.072288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.073458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.074912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.076933 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 207/406] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:07 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:08.085861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.206195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4607-4465-40f8-973f-c31b18441e88 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.248904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.249597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.249880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.250147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.251442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.252934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.254986 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 208/407] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:08.260522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.288498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181419-5f96-42fb-b218-d42bdd887f16 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.289199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.330639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.333725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.334834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.335414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.336159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.338554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.340419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.342266 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 200/408] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:08.343176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.376811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f055a55-206d-4707-b430-74706b91e4cc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.414372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.415039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.415368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.415635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/groups/c56847dc8db342c49af49c90beb67573/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.418771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, group_id=c56847dc8db342c49af49c90beb67573, role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.420299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.437997 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 209/409] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Aug 21 00:56:08 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/groups/c56847dc8db342c49af49c90beb67573/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:08.438808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.480851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4e46-4942-497a-97cf-895ff29fbca0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.526093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.526752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.527032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.527303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.551269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.556067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:08.565480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:08.566454 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:08.567252 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:08.570288 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 201/410] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:08.577684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.584756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376d5-1897-4423-8d9f-f8a76c29d80e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.657182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.658140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.658411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.658678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/groups/c56847dc8db342c49af49c90beb67573/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.660844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ceaa9e01b44c10882456ca0473d0a2, group_id=c56847dc8db342c49af49c90beb67573, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.662347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666290-8610-45a3-8cc4-c337f5c8d933 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.668425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.680589 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 210/411] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Aug 21 00:56:08 2022] PUT /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2/groups/c56847dc8db342c49af49c90beb67573/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:08.739029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7068-d6bf-4dc3-8137-acac2613c07c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.769296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4416-860a-4d6f-960d-1ae7dc1ae4f0 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.769877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4416-860a-4d6f-960d-1ae7dc1ae4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.769877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4416-860a-4d6f-960d-1ae7dc1ae4f0 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.771321 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 211/412] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:08.779526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.780004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.780512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.785162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.785783 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.786056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.786322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.787000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:08.787296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.788748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.803657 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 202/413] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:08.810333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:08.828943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:08.830435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:08.930273 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 212/414] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:08.939529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d327-8369-4e08-806c-7aa9632da3a4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:08.964464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:08.980415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:08.981116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:08.981392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:08.981663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] PATH_INFO: `/v3/groups/89d8b7e583194652ad4a91e845cbb9bc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:08.982900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] RBAC: Authorizing `identity:get_group(group_id=89d8b7e583194652ad4a91e845cbb9bc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:08.984445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:08.986377 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 203/415] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/groups/89d8b7e583194652ad4a91e845cbb9bc => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:08.992034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:09.089579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:09.119530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132093f-6d47-4e65-98d5-9bf43c1308fc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:09.154342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:09.154974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.155245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.155507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] PATH_INFO: `/v3/projects/977498717dcb4d37929af17aaaa0285d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.156662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] RBAC: Authorizing `identity:get_project(project_id=977498717dcb4d37929af17aaaa0285d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:09.158102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:09.159713 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 213/416] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:08 2022] GET /identity/v3/projects/977498717dcb4d37929af17aaaa0285d => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:09.165736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:09.314382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e861e8-68ad-42fa-b9d6-23b9aa422a1c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:09.359869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:09.360599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.360879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.361151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] PATH_INFO: `/v3/projects/977498717dcb4d37929af17aaaa0285d/groups/89d8b7e583194652ad4a91e845cbb9bc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.363059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] RBAC: Authorizing `identity:create_grant(project_id=977498717dcb4d37929af17aaaa0285d, group_id=89d8b7e583194652ad4a91e845cbb9bc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:09.364533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:09.388756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:09.394412 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 204/417] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Aug 21 00:56:09 2022] PUT /identity/v3/projects/977498717dcb4d37929af17aaaa0285d/groups/89d8b7e583194652ad4a91e845cbb9bc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:09.526384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ea9c-8489-42ff-aebc-fc7b2741b6db None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:09.566977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:09.567521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.567817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.568126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.579357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:09.584346 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:09.585268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:09.586176 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 214/418] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:09.593108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:09.631534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:09.702532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102c69-2b9e-4636-b5af-b01878ad0f9d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:09.738413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:09.739033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.739310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.739579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.740283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:09.740584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:09.741961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208f8e2-06c6-470f-96e2-a3f682039f87 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:09.750990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 205/419] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:09.756802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:09.764869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:09.890819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd8d55-7236-4acb-8743-7c79a60b50a1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:09.939877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:09.940805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.941226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.941663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.980908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf2b7-e67b-4695-acde-992079648f3d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.981342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf2b7-e67b-4695-acde-992079648f3d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.981718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf2b7-e67b-4695-acde-992079648f3d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.983169 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 206/420] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:09.988875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.991158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.991578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.026277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:10.030735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:10.054409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:10.055967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:10.060738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:10.156376 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 207/421] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:10.199883 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 215/422] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:10.205714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.240557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:10.333893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4add-84b8-4a1b-b405-96ef6a39a7c9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.376388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.377022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.377292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.377557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.381392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:10.382841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:10.384497 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 208/423] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:10.390300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.477099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.526225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf358e5-5b9c-4c09-b366-4bdb28353386 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.528784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:10.586337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.586970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.587252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.587511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.589790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:10.591269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:10.599855 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:10.610249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.651290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:10.657717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a184-e653-4cf6-9df8-caf26e303e25 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.698972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.699610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.699924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.700188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.712039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:10.719437 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:10.720401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:10.721201 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 209/425] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:10.731003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.814797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d376c-0c5c-4056-a3ed-2973cd33e4e1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.892874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3974-5288-43ec-a1de-58eed5c47abc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.893118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.893575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.893861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.894097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.894839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:10.895142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:10.896608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:10.913971 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 217/426] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:10.933095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.934187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.934730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.935287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.936362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:10.936877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:10.938630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5461-94fe-4dec-9cfe-cdd7a98f2536 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:10.949195 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 210/427] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:10.955296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.006516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.088580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd9fe0-fa45-41e1-ac01-fd07ab37a4dc None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.089395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd9fe0-fa45-41e1-ac01-fd07ab37a4dc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.089864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd9fe0-fa45-41e1-ac01-fd07ab37a4dc None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.091434 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 211/428] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:11.106439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331061a-ba0b-40d8-8dd0-a4a2f85f9bcf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.112564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24eee-429d-41e6-9af7-da5f960050ec None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.112844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24eee-429d-41e6-9af7-da5f960050ec None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.113117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24eee-429d-41e6-9af7-da5f960050ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.143483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-53a24eee-429d-41e6-9af7-da5f960050ec None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:11.144708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-53a24eee-429d-41e6-9af7-da5f960050ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:11.161251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.162221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.162685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.163431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.163984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.235929 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 212/429] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:11.252237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.254710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.303865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.314995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d0fa-b92b-4b6b-b2dc-c77ff15c5222 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.315311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d0fa-b92b-4b6b-b2dc-c77ff15c5222 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.315514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d0fa-b92b-4b6b-b2dc-c77ff15c5222 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.319206 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 213/430] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:11.322831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.323234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.323885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.346406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:11.347886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:11.377061 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 218/431] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:11.382928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.429443 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 214/432] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:11.502308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522086b-a3ed-4543-be8a-f41fbd7b4b33 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.550834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.551423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.551707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.552095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] PATH_INFO: `/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.554367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.556031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4ab916068b43f4995ee1de5a3b90b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.557569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.559577 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 219/433] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/projects/aa4ab916068b43f4995ee1de5a3b90b8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:11.564826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.569345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.666129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.697502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5af4d-17fe-4806-8f06-8b94685fa0e4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.699831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdea7d8-5057-4b7c-8d17-65c66eb842d1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.740988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.743774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.743774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.743774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.743774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.745239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.745581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2b2d-0cfb-4a72-9c48-090bc55fbcb2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.745900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.746177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.746450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.747209 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 220/434] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:11.748437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a819a-7ab9-44a2-9738-951045c610f7 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.748723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a819a-7ab9-44a2-9738-951045c610f7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.748993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a819a-7ab9-44a2-9738-951045c610f7 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.750323 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 221/435] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:11.750872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a819a-7ab9-44a2-9738-951045c610f7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.759847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:11.765369 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:11.766288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:11.767101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 215/436] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:11.767814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.826333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.858429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a819a-7ab9-44a2-9738-951045c610f7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.870239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba426-7447-4d8b-a8f2-31f340473f8a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.892233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.892865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.893139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.893686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.902850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.903431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:11.903588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.903963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.904236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.904968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:11.905273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.906714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b1332979-e50e-4771-8fd4-cdd9b8e5398f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:11.908166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:11.909034 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:11.909856 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 222/437] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:11.910511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.911209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.911209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.915195 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 216/438] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=aa4ab916068b43f4995ee1de5a3b90b8&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:11.916023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.927331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.933810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:11.935347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:12.023763 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 223/439] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:12.023763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.051802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d175be-1880-4a9a-95f9-5ee080f222ef None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.098972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.099703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.100118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.100701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.101384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:12.101685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.102598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.103068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.115784 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 217/440] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.118507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.164301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897db8-2dbc-420b-bb5e-de4e8827a393 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.195484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.222884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.223827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.224247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.224682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.225364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:12.225666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.227217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.239304 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 224/441] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.243376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.253592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513a2e1-1ab9-4299-b847-7eabd12aede2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.304124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.305395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.305834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.306107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.367846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b5d0-ec0f-4c85-a0d3-a98c9df409f3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.374535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.376024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.391761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.403328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.403971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.404251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.404520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.436937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.473022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.474487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.475280 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 218/442] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:12.476604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.575532 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 225/443] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:56:12.576412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.585566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ce5-8833-4498-a7e0-3ffce0d278e6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.603971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.628017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.628544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.628819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.629068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.639605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:12.644402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:12.645289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:12.646134 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 219/444] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:12.646812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.672291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.689414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32be66-00b1-4b66-845f-6bee7a33e2da None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.723894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.724490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.724758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.725021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.726139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.727591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.734113 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 226/445] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.734113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.751133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b991f4-7eb6-4355-bcea-e5e63ba244f6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.786260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.786891 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.787165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.787446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] PATH_INFO: `/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.788671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] RBAC: Authorizing `identity:get_project(project_id=d5ceaa9e01b44c10882456ca0473d0a2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.790161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.792288 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 220/446] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/projects/d5ceaa9e01b44c10882456ca0473d0a2 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.793042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.825268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.834025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b21de-affd-40cd-b404-6a9045cf9933 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.868062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.868660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.868925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.869182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.870139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:12.870437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.871833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.879885 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 227/447] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.880659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.884696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.894136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1748bdf-5334-4e0a-80f9-fc30c8c9fb6e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.927851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.928478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.928749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.929014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.930106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.931547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.933261 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 221/448] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.934006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.987750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a768-42e6-42d1-901b-c2e2d09caa2a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.030107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.030761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.031127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.031521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] PATH_INFO: `/v3/groups/c56847dc8db342c49af49c90beb67573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.033419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] RBAC: Authorizing `identity:get_group(group_id=c56847dc8db342c49af49c90beb67573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.035600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.038983 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 228/449] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/groups/c56847dc8db342c49af49c90beb67573 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:13.040582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.051257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a650c9a-262b-41bd-9c04-a4707e4fb01b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.066099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.085805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.086452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.086720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.086988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.115333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.142110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73764f-0054-4164-8709-7aeb33f69c76 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.154871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.156366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.178154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.178756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.179029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.179315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.180078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:13.180387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.181840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.189047 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 229/450] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:13.189824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.260868 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 222/451] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:13.266978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.287318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.308161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed0c-8cfa-454d-a624-60650f7bca93 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.337427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.351073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.351690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.352003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.352273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.353009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] RBAC: Adding query filter params (group.id=c56847dc8db342c49af49c90beb67573, role.id=b3fbac766b24473a8e72d9b338bc8722, scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:13.353314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.354913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.362364 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 230/452] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/role_assignments?group.id=c56847dc8db342c49af49c90beb67573&scope.project.id=d5ceaa9e01b44c10882456ca0473d0a2&role.id=b3fbac766b24473a8e72d9b338bc8722 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:13.392216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c8b5-eda4-4b1f-afa1-cbb506e1ed7c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.434138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.434792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.435067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.435336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] PATH_INFO: `/v3/projects/977498717dcb4d37929af17aaaa0285d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.436531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] RBAC: Authorizing `identity:get_project(project_id=977498717dcb4d37929af17aaaa0285d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.437986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.439681 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 223/453] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/projects/977498717dcb4d37929af17aaaa0285d => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:13.445654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.547131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89c2a-e54c-473a-ad69-b7ece446ea2a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.580845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.581478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.581757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.582029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] PATH_INFO: `/v3/groups/89d8b7e583194652ad4a91e845cbb9bc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.583162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] RBAC: Authorizing `identity:get_group(group_id=89d8b7e583194652ad4a91e845cbb9bc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.584697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21f7e-1b93-427d-b9b4-838fda9213e2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.586275 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 231/454] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/groups/89d8b7e583194652ad4a91e845cbb9bc => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:13.592583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.699355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ef9c-6b33-4777-b384-ebfdd7172035 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.725401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.734001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.734614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.734889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.735156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.735912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] RBAC: Adding query filter params (group.id=89d8b7e583194652ad4a91e845cbb9bc, role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=977498717dcb4d37929af17aaaa0285d) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:13.736218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.737649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ea88-558c-4ec2-9715-0f862105c6f6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.743402 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 224/455] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/role_assignments?group.id=89d8b7e583194652ad4a91e845cbb9bc&scope.project.id=977498717dcb4d37929af17aaaa0285d&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:16.076380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb98d-c424-419f-ab57-0f281c6999b5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.077366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb98d-c424-419f-ab57-0f281c6999b5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.077901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb98d-c424-419f-ab57-0f281c6999b5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.079764 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 232/456] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:16.084958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935569-71ff-4fc2-a2f8-289d5d197751 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.085372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935569-71ff-4fc2-a2f8-289d5d197751 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.085567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935569-71ff-4fc2-a2f8-289d5d197751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.109015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f5935569-71ff-4fc2-a2f8-289d5d197751 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:16.110191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f5935569-71ff-4fc2-a2f8-289d5d197751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:16.206183 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 225/457] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:16.281128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b497b9-2cbd-4ead-b46e-1a2b7100dcee None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.281450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b497b9-2cbd-4ead-b46e-1a2b7100dcee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.281674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b497b9-2cbd-4ead-b46e-1a2b7100dcee None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.283294 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 233/458] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:16.288794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380883-c38f-4e3b-8dc7-0dbe8256567b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.289074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380883-c38f-4e3b-8dc7-0dbe8256567b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.289336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380883-c38f-4e3b-8dc7-0dbe8256567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.315867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3f380883-c38f-4e3b-8dc7-0dbe8256567b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:16.317394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3f380883-c38f-4e3b-8dc7-0dbe8256567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:16.414040 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 226/459] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:16.523828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b497b9-2cbd-4ead-b46e-1a2b7100dcee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:16.551020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:16.653186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b497b9-2cbd-4ead-b46e-1a2b7100dcee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:16.674585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e842a-10ce-4e84-9104-3a2de7c1e94e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.675157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e842a-10ce-4e84-9104-3a2de7c1e94e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.675623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e842a-10ce-4e84-9104-3a2de7c1e94e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.677408 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 227/460] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:16.682951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.683495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.684001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.699775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:16.699775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.699775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.699775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.705526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:16.707169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:16.725311 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:16.726295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:16.727188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:16.727188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:16.727188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:16.735110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:16.736377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:16.739261 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 234/461] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:16.740774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:16.798001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:16.824881 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 228/462] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:16.826142 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:16.828226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:16.863128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58868ab7-e6f9-4fc7-9421-4b46ec15e863 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:16.899316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:16.899946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.900217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.900485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:16.901291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:16.901620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:16.903175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:16.921679 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 235/463] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:16.923043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:16.946004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac35ff4-b911-408c-9426-f7d3fc3004c9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:16.987791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:16.988443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:16.988721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:16.989143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.002506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.004013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:17.022506 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:17.024472 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:17.025624 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:17.025624 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.025624 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:17.029882 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 229/464] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:17.030985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.038658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc3ac-07ae-4b5a-bf7f-e0403f7078b3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.071554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.077492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.083226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.084459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.084874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.085454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.087064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.089100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f54bd-487a-4e0a-a107-5d0e987befab None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.129002 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 236/465] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:16 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:56:17.193662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2bc3b-c870-4340-b3a1-57bc60f24956 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.225227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193253d-17be-4ec0-b5fc-d84b20d42cda None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.225728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193253d-17be-4ec0-b5fc-d84b20d42cda None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.226146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193253d-17be-4ec0-b5fc-d84b20d42cda None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.227733 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 237/466] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:17.241746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.242377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.242833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.244510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.245139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.245416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.245690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.246349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:17.246652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.251763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.261862 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 230/467] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:17.275862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.276204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:17.277758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:17.355159 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 238/468] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:17.360622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.395883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.404077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f71e-6ffc-4051-ac65-061b81838dc0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.453068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.453941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.454364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.454774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.455557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.457727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf354-f0f2-43c1-a2be-0e5ae73cc764 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.485699 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 231/469] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:17 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:17.487230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9ba7-2274-460d-9b72-72b7e06dbd0a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.487702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9ba7-2274-460d-9b72-72b7e06dbd0a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.488071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9ba7-2274-460d-9b72-72b7e06dbd0a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.489342 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 232/470] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:17.493080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2366c-b28d-4baa-b0dc-ced12eedf6b6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.498357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.498672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.498907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.520911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.525684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:17.528277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:17.543527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.544553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.544663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.544862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.557895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.559564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:17.577022 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:17.578026 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:17.578892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:17.578892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.578892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:17.578892 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 239/471] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:17.584673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.613947 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 233/472] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:17.641251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.698500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788619-9d0f-42a4-bac9-db596786bd31 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.737371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.737907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.738183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.738517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.739323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:17.739627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.741239 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.750361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.762981 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 240/473] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:17.763987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.775001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeb6ec-8434-4282-9f47-fc47ddd78a6a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.794041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:17.821598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.823415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.824036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.824647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.839155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.842022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:17.861398 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:17.862368 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:17.863250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:17.863250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:17.863250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:17.865715 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 234/474] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:17.874446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:17.882475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3f0af-72ee-4239-9283-76cc534adfdc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:17.928835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:17.929453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:17.929729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:17.929997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:17.930655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:17.932354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:17.967071 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 241/475] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:17 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:17.967766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:18.007236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397702ce-e932-44bd-b45d-4758a0726c8c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.040249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:18.049535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.050178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.050447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.050715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.051376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:18.051676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:18.053106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:18.076436 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 235/476] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:18.083641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:18.113583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:18.144904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf13b51-a9bc-484d-99b2-1f822008ed37 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.210632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.211352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.211582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.211919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.212598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:18.214427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:18.224788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.sql.core [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:56:18.224788 dv-cinder-master-3-smb devstack@keystone.service[81510]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:56:18.224788 dv-cinder-master-3-smb devstack@keystone.service[81510]: [parameters: {'id': '5cd48816405d45bc9455d3fee3a8f9b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:56:18.224788 dv-cinder-master-3-smb devstack@keystone.service[81510]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81510) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:56:18.244384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return ref.to_dict() Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:56:18.245881 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application yield resource Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise self.value Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application session.commit() Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:56:18.251974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:56:18.253031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:56:18.254109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:56:18.255112 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [parameters: {'id': '5cd48816405d45bc9455d3fee3a8f9b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:18.256383 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:56:18.258155 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.260215 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 242/477] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Aug 21 00:56:17 2022] POST /identity/v3/roles => generated 144 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:18.260360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff62e9e-051c-42a9-95df-ea2ca2c70aac None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.262925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:18.315939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.316805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.317534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.317812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.318469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:18.320545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:18.351025 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 236/478] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:18 2022] POST /identity/v3/users => generated 249 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:18.407178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c404ee0-a7cd-4196-b04f-f0d44aa4b74d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.456119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.456783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.457058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.457326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.476168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4ca54548-2803-4886-b24e-64663f74c62b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:18.481970 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:18.484378 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:18.486257 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 243/479] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:18.493785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:18.573710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:18.615206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2e260-5812-45a6-add1-942752ec95cc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.654464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.655109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.655388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.655657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.656374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:18.656671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:18.658076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035524-d0eb-4343-9524-c22dd81fae56 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:18.670101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 237/480] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:19.657237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287a9b-9942-4a43-8f42-a380ab9f7074 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.658312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287a9b-9942-4a43-8f42-a380ab9f7074 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.658816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287a9b-9942-4a43-8f42-a380ab9f7074 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.661319 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 244/481] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:19.667202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73672-02c7-49c4-844a-08d093680d8e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.667978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73672-02c7-49c4-844a-08d093680d8e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.667978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73672-02c7-49c4-844a-08d093680d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.702137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-47b73672-02c7-49c4-844a-08d093680d8e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:19.703509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47b73672-02c7-49c4-844a-08d093680d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:19.821246 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 238/482] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:19.938773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e938-8925-4c08-8c5d-174eafb2ba39 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.938959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e938-8925-4c08-8c5d-174eafb2ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.939214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e938-8925-4c08-8c5d-174eafb2ba39 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.940864 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 245/483] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:19.946038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.946326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.946656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.964802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:19.965976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:20.016461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.062276 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 239/484] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:20.313221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37e938-8925-4c08-8c5d-174eafb2ba39 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.325136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.373909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.478930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37e938-8925-4c08-8c5d-174eafb2ba39 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.543027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062277-341c-41ae-a71f-f4eb60aaa613 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.547536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.548205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.548476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.548785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.570705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:20.576870 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:20.577810 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:20.578660 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:20.579877 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 246/485] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:20.584408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.610947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.611597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.611901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.613107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.638797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:20.645043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:20.645952 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:20.646777 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 240/486] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:20.652680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.708351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.715691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.761051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13e3fb-baa1-4bd6-8178-a6cb601be97f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.800111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a163-4bad-4eba-8fa3-02bc201394c9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.803973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.804590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.804861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.805127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.805793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:20.806092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.807689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909e41-4ce9-476c-8a2e-9935e5db963a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.818957 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 247/487] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:20.820373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f3323-52f5-4639-ae35-8316a9ae9639 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.820655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f3323-52f5-4639-ae35-8316a9ae9639 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.820928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f3323-52f5-4639-ae35-8316a9ae9639 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.827276 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 248/488] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:20.828160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f3323-52f5-4639-ae35-8316a9ae9639 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.847504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.848169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.848625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.848894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.849997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:20.850559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.852139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496be-79db-4116-8e88-9c350853e3db None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.863435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 241/489] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:20.865130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.865547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.865821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.888913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:20.890384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:20.957507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f3323-52f5-4639-ae35-8316a9ae9639 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.971094 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 242/490] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:20.980153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.992457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.008757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.009397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.009665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.010045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.027927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.036377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.037872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:21.070974 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.073680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:21.075775 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:21.075775 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:21.075775 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:21.075775 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 249/491] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.080903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.140022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cc290-96a1-4585-af1a-4e1f06f72fcd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.176196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.176833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.177108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.177374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.188229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.190038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-97a6c6cd-dc0c-4600-aa71-369089fc8144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:21.207063 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.209274 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:21.211340 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:21.211340 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:21.211340 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:21.211712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ade08-f4f1-4e62-990d-b3846c832b46 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.219763 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 243/492] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.219763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c277b-a162-4104-9da6-e668f2ed58f3 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.219763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c277b-a162-4104-9da6-e668f2ed58f3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.219763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c277b-a162-4104-9da6-e668f2ed58f3 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.220445 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 244/493] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:21.220871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c277b-a162-4104-9da6-e668f2ed58f3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.249217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.249980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.250252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.250518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.251715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:21.252046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.253889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c36854-c54a-446c-9c5b-565b14845e75 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.269123 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 250/494] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:21.270989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.271403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.271801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.296944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:21.298486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:21.300857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.332169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c277b-a162-4104-9da6-e668f2ed58f3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.336623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.366269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.366878 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.367148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.367412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.368077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:21.368521 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 251/495] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:21.368622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.369444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.369993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.381392 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 245/496] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:21.382167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.481057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d000-a09b-4bd7-8538-3780d9e3f804 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.481266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38c03-d03b-46b0-b1b0-bd7458671449 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.516418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.517038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.517313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.517563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.519407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.520051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.521132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.521569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.521977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.525828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.527320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.533858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:21.538847 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.539960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:21.540979 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b808cf4c-a3d2-4825-bc90-bb0aa71b16ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:21.542065 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.542876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 246/497] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6647-c860-4b4a-93c1-57f88f7f88b7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.543817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6647-c860-4b4a-93c1-57f88f7f88b7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.544541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6647-c860-4b4a-93c1-57f88f7f88b7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.545165 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 247/498] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:21.547865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6647-c860-4b4a-93c1-57f88f7f88b7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.548768 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 252/499] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.549642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.586531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.658076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327ba8-3da1-4223-b7a0-7d96e2f5a2bd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.659496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6647-c860-4b4a-93c1-57f88f7f88b7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.691452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.692098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.692371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.692638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.693125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.693359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:21.693653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.693741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.694016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.694286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.695092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.701717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.703192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-30e232d3-c2c5-42c3-9c8a-6da7649c3376 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:21.714272 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.715216 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 248/500] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.716648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.717280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.717280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.736522 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 253/501] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:21.736522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.737134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:21.737862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:21.787823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.805418 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 249/502] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:21.806244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.824485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.835791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a109-79f3-42bb-8235-4feb484b2b08 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.880730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.881580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.881857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.882178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.882851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:21.883197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.884694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.897469 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 254/503] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:21.897469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.911770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e981-9d2f-4c14-bfba-7bc808005666 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.949896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.950534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.950808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.951076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.961259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:21.966137 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.967096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:21.967950 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 250/504] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:21.968848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.007996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d887ed-f885-47e8-a968-02e29d32b49e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.021558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.044246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.044849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.045098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.045358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.046153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:22.046437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.047908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.065276 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 255/505] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:22.066077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.078462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.091631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdbc27-eaf5-45d4-aa7e-a675961b5945 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.124573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.125180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.125454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.125717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.169093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb015dd-cd27-4382-a2d1-cb00dd022d60 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.196870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.198433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.204931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.205561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.205841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.206107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.216238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.217688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:22.232340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:22.233420 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:22.234324 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:22.234324 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.234324 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:22.234324 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 256/506] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:22.234324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.244870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.300917 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.304854 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 251/507] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:22.305690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.345123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da21a37-65e0-4d5e-9977-a2401084ea0f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.378076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.378657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.378945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.379209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.379896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:22.380180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.381569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.389701 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 257/508] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:22.390316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.403260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177f4d-343a-48cc-aa9e-881711ffa201 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.436301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.436893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.437168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.437432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.451507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.489637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17706a-d737-4a22-bed6-b3689aa21b77 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.509349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.511367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.518923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.532178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.532814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.533090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.533356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.545243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.546739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:22.561521 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:22.562473 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:22.563326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:22.563326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.563326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:22.563326 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 258/509] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:22.563538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.626300 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 252/510] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:22.627143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.665952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480bf3-7023-42c6-ad0e-3fe675ba46b6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.673710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.702486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.703378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.703378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.703574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.704245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:22.704541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.706007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.717781 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 259/511] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:22.718729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.740007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1f3e4-156a-43c5-adf4-7e69c1de3464 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.759853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.778841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.779481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.779779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.780054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.792786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.794510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:22.809497 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:22.810483 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:22.811526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:22.811526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.811526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:22.811526 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 253/512] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:22.811934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.836845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac52f50-7c2f-4337-a619-fd71d3344f2c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.876589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.877221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.877501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.877767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.888235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.889711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:22.905749 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:22.906732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:22.907621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:22.907621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:22.907621 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:22.907621 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 260/513] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:22.907621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:22.927027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:22.939430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca4ec-849b-4cbe-86ce-8ccd88c22739 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:22.974657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:22.975285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:22.975618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:22.975945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:22.976596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:22.976896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:22.978278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:22.990172 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 254/514] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:22.991400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.004628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.017235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fab-8e8c-40fb-95b5-b07a79e53a09 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.050622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.051250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.051523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.051815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.062724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.064253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:23.080018 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:23.081121 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:23.082031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:23.082031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:23.082031 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:23.082031 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 261/515] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:23.082246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.097162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a526-32b6-42fa-8d4a-75cc024d8b5d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.131335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.131994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.132268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.132530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.139695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.141192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:23.152546 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:23.153605 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 255/516] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:23.159471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.176640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.183502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bac2a-5624-4552-bef3-2e11094b6462 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.216706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.217331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.218066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.218066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.218481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:23.218778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.220214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.229162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.232491 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 262/517] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:23.233542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.260982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6153-cdb9-492b-9080-39331ab2bfb4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.298289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.299018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.299286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.299550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.300256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:23.300525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.301913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.313639 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 256/518] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:23.314434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.340700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde3a9e-7cd2-49b2-b8ab-ec29542fddfe None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.373640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.374244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.374516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.374781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.375415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.376901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.390827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.398109 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 263/519] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:23 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:23.399069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.418330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74717a5-8618-4d42-9344-57fe31fd9744 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.460818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.461402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.461517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.461703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.461981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.462714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:23.463218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.464973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.483271 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 257/520] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:23.484216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.513134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26bf36-2a4e-4cd4-93da-820b72bced0f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.555226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.555957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.556229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.556491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.559416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:23.559979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.561265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.582104 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 264/521] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:23.583957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.598336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a1e94-e45c-4b0a-a6f7-8d02fb19ec79 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.644466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.645692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.646137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.646576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.650724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.657861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.660353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:23.679998 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:23.681150 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:23.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 258/522] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:23.690433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.742184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1c8d-d32d-482c-85cd-c764c4efa548 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.763943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.792716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.793398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.793653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.793923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.803914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.805346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:23.818676 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:23.819619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:23.826041 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:23.826664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee67e-1b63-44d7-8a02-1ee6500e8177 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.827211 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 265/523] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:23.827211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.863030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.863664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.863971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.864240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.871952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:23.873752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:23.885681 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:23.886602 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:23.887487 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 259/524] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:23.888000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:23.930965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920996-60a8-4a9f-bafb-15b9ef0d3fe5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:23.947887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:23.968728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:23.969345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:23.969608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:23.969877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:23.996380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaeb31-adff-4f02-a458-8dac11b58964 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.015260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.032254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.032964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.033185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.033395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.034088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:24.034387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.035847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.043955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.045449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.054819 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 260/525] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:24.060389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.150334 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 266/526] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:24.152644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.162012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3869a-560d-4a30-8e83-3548bc3788b1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.179070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.197727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.198413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.198688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.198953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.199678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:24.200004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.201434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.243836 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 261/527] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:24.244721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.245331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.277292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9ea80-5bd7-44a4-9dc0-611f6c60f72e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.317480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.318206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.318535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.318860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.319564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:24.319891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.321346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.339781 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 267/528] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:24.344922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.348760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664941b-32af-4c48-a2fb-f08e409013fc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.382130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.382735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.383006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.383269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.384015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:24.384317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.385892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.391459 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 262/529] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:24.392294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.450225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.468389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf0be3-6a79-407e-9105-161b23822210 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.511997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.513105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.513528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.513972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.516801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.528802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.530658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.544430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc9b5-8416-4faf-b4e3-7ee9ad627ed2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:24.548484 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:24.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:24.550296 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:24.550296 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:24.550296 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:24.554455 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 268/530] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:24.555410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.587872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.588925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.589307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.589721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.662485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.664084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.676260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f37a1-89e4-4ca2-8fc5-d79829be0c19 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.713649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.724138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.725383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.725887 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.726348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.727258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=6b5bfa3fddfc4d1cb865331a2f5e4d0e) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:24.728354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.730441 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:24.747770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 269/531] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/role_assignments?user.id=6b5bfa3fddfc4d1cb865331a2f5e4d0e&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:24.747770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.804975 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 263/532] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:24.812159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:24.866641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.942823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa8d0-08ce-4201-b2d7-2a718f3cbb7a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.976684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6e39-deff-416e-9302-80e710f9bcf5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:24.979492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:24.980398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.980681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.980954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.990020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:24.995228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:24.997374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:25.014084 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:25.015100 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:25.015999 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:25.015999 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:25.015999 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:25.015999 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 264/533] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:25.021178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.036192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.036810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.037096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.037363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.039908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.040225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.042242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.068526 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 270/534] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.072132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.210925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ba56-e820-4ba6-a37b-911bccf139f5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.254182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0be78-6e5e-4168-b5e3-865e4bd2c387 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.273202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.273822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.274099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.274385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.275018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.275410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.276914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.283352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.304634 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 265/535] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.309875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.330481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.331044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.331317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.331879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.348107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.349608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:25.367860 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:25.368791 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:25.370480 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 271/536] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:25.380969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.392454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.456189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e861f06-9355-4924-98bd-bc05f40023d0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.499385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.500045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab297d4-e956-4248-81ec-b268a6994a6c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.500487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.500905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.501309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.510108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.512957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-2f812611-0f7c-409e-a333-bf182d791cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:25.533266 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:25.534350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:25.535395 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:25.537833 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 266/537] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:25.539170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a34da-8c21-4599-95b6-dd159532d6cf None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.539581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a34da-8c21-4599-95b6-dd159532d6cf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.540001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a34da-8c21-4599-95b6-dd159532d6cf None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.542295 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 267/538] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:25.543850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a34da-8c21-4599-95b6-dd159532d6cf None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.544471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.545305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.545691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.546055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.547114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.547616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.549414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cc77c-228e-4781-8d4b-f113b49a166d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.568124 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 272/539] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.569465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.569844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.570215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.590727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:25.591636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:25.618178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.668785 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 273/540] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:25.669942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.677881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a34da-8c21-4599-95b6-dd159532d6cf None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.691988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.722096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.722706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.722981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.723253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.724208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.724511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.726112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.739639 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 268/541] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.746172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.852770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8579a4-344c-4320-8f43-222464f05d42 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.875617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfe9fe-e66b-4ae1-b71f-491eaa1549e1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.888842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.889514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.889794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.890062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.890794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=244d9918798e46afac5635b7374e0ad0) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.891099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.892572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.898550 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 269/542] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/role_assignments?user.id=244d9918798e46afac5635b7374e0ad0&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.934404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.935026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.935298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.935565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.940651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=3bc1abc667b4456d89f42912085211e5) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.940966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.942462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.949320 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 274/543] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/role_assignments?user.id=3bc1abc667b4456d89f42912085211e5&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:26.018926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.066344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.151046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34da5-b9cc-4649-90ae-1ac928773e56 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.192540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.193180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.193452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.193715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.211770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:26.217209 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:26.218129 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:26.218949 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 270/544] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:26.225983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.265036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.347013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2066-96cf-455c-84e4-09cf963b0d32 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.381210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.381825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.382097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.382361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.383029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:26.383326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.385085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44941d99-f02b-49b2-bedf-4d862e3eaf95 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.393696 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 275/545] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:26.399195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.518951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.526298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb81f7-fdea-47df-b667-f20761a6534b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.575945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.576606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.576879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.577145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.592071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.593182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e665cb-91c3-4126-98aa-3219f88e5dde None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.593463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e665cb-91c3-4126-98aa-3219f88e5dde None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.593566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.593721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e665cb-91c3-4126-98aa-3219f88e5dde None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.595311 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 276/546] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:26.600225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.600503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.600771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:26.610016 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:26.610971 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:26.611857 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:26.611857 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:26.611857 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:26.611857 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 271/547] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:26.617073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.641844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:26.643840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:26.776355 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 277/548] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:26.786646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5aea5-06cb-4d7d-852d-c9ff35086862 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.839849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.840594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.840873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.841126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.841772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:26.842072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.843450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.865007 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 272/549] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:26.870440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.894281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.987623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abcec1-e167-4e3a-b31c-41a007c26aa6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.031321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.031910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.032187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.032453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.040114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.042013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a1a69945-1396-42c6-ad3c-456612754b70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:27.059384 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:27.060380 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:27.062055 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 278/550] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:27.068850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.082246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.135068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f363da-5d24-4d0b-8e04-da4b44101a07 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.135774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f363da-5d24-4d0b-8e04-da4b44101a07 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.136285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f363da-5d24-4d0b-8e04-da4b44101a07 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.138124 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 279/551] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:27.143330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.143893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.144386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.177200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:27.179542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:27.253443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658cf5-a7b7-45e5-9be4-43eb24183974 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.267821 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 280/552] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:27.267821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.274118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.332090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.332883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.333257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.339789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.340688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:27.341094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.342722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.375646 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 273/553] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:27.377956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cc0e-41ff-4ea9-a109-11fbd5e13fd5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.380846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.424819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.425466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.425738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.426004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.447940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:27.452700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:27.453691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:27.454608 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 281/554] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:27.460566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.480105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.539505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406dc5-134a-44ee-a3ec-e2f400297fde None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.575183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.579850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.580475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.580875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.581151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.641173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76244-3317-49c4-ad66-608f9408c2fc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.678769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.680282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.691349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.692107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.692371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.692641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.693316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:27.693616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.695205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.704407 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 282/555] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:27.705341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.741645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.780600 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 274/556] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:56:27.781472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.816925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f566d-a7ad-470e-9e01-bbef01e1760b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.847164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.857658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.858650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.859076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.859592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.872207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:27.877964 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:27.879109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:27.880134 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:27.887262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f3d3e-f4f1-418f-ba64-4fc9cdd01dba None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.888798 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 283/557] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:27.889929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.921755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.922150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.922425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.922694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.933512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.934981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:27.950625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:27.952352 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:27.953480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:27.953480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:27.953480 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:27.953480 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 275/558] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:27.953480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.972380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.009978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0878a9-d30c-4980-9dea-56c733ea5277 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.048113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.049129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.049570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.049983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.054795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50c35-3f2b-440e-8e88-dbe04eec4f9a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.062223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.064093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:28.080219 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.081181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:28.082184 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:28.082184 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:28.082184 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:28.084230 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 284/559] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:28.085201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.093400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.094010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.094290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.094613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.095291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.095589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.097416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.110696 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 276/560] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.110696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.139127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.191523 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.209996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de239-85c6-4896-adb9-1698a5496ba9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.213945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6811-5766-4bc3-a15f-aa8e984d2031 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.245022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.245637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.245913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.246194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.246844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.247142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.248586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.251122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.251731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.252039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.252304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.252935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.253229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.254715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad0c30-8381-4974-8dfd-11480f5201ef None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.264994 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 285/561] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.264994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.267110 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 277/562] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.268428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a2423-baba-4b7f-920e-9c5d4dbcbbcc None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.268742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a2423-baba-4b7f-920e-9c5d4dbcbbcc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.268989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a2423-baba-4b7f-920e-9c5d4dbcbbcc None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.270453 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 278/563] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:28.271465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e924-2f95-42f6-8a6f-5b9f9c53152d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.272038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e924-2f95-42f6-8a6f-5b9f9c53152d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.272314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e924-2f95-42f6-8a6f-5b9f9c53152d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.273499 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 279/564] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:28.274408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e924-2f95-42f6-8a6f-5b9f9c53152d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.369403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.372290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3f08-0d80-4fd1-9154-a1e206bd247d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.378769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e924-2f95-42f6-8a6f-5b9f9c53152d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.406762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.407393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.407669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.407960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.411599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.412248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.412515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.412777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.418393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.419903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.420312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.421721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.423452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:28.434253 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.435240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:28.441053 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a9962777-aa25-4a06-8f8d-63d116955a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:28.441602 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.442460 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:28.443377 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:28.443377 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:28.443377 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:28.443546 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 280/565] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:28.443615 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 286/566] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:28.443690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.443795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7e29-cd1a-4e24-addc-af3a99f8fdd2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.443795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7e29-cd1a-4e24-addc-af3a99f8fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.443795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7e29-cd1a-4e24-addc-af3a99f8fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.455782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-504b7e29-cd1a-4e24-addc-af3a99f8fdd2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:28.456983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-504b7e29-cd1a-4e24-addc-af3a99f8fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:28.524395 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 287/567] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:28.525604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.526373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.526646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.548416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:28.549812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:28.550624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0d0d-fb25-40fd-badf-b247fbad72a0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.585371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.586006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.586284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.586552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.593716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.595165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:28.607096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.608211 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:28.609345 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:28.610156 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 281/568] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:28.610832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.634189 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 288/569] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:28.635086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.652332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.685489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.731303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cfe3a-deca-4f8b-9e11-ce3400787bdb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.743667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218765-05fd-4b0f-8b66-ae55d94d63df None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.766791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.767779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.768250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.768754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.769782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.770277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.772158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.780269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.780885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.781161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.781427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.782176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.782477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.784046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.792681 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 282/570] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.793779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.798441 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 289/571] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.799342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.873039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.900178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471408-8114-4704-8ef4-02a7c2c7b02c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.909830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa6d30-bc93-4f74-bf09-ed7429d7ea47 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.916820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.934756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.935358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.935634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.935926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.936610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.936906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.938337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.943833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.944478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.944779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.945038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.949705 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 283/572] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.950487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.958342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:28.964087 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.965048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 290/573] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:28.966097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.055160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff084b-55a2-4034-91be-745dc37a7289 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.061208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10249867-a0dc-4861-aac2-5ada187a56a2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.086945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.087657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.088007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.088283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.089570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.094870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.095490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.095788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.096051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.098860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.100342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.103731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.105236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:29.114424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.115363 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:29.116288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:29.116288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.116288 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:29.116288 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 284/574] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:29.116526 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.122558 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:29.123524 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:29.124113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.124198 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 291/575] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.124198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.153797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.219612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1682c-e969-4510-9624-47ac1e342fdd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.226797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a266a1-955c-45f7-acc1-b82a08e015fa None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.253336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.253950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.254225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.254495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.255227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=9842b5bcc876492e9e765c86a3ba3138) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:29.255554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.257073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.260368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.261006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.261282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.261545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.262555 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 292/576] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/role_assignments?user.id=9842b5bcc876492e9e765c86a3ba3138&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:29.263335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.282556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:29.288623 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.289501 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:29.290354 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 285/577] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.291099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.333662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.388217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4fac0-bc2e-43dc-80ec-3cbd6f03560c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.398501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.412027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0374c-01ed-41f1-96b2-080bdb7acc95 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.435793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.435793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.435793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.435793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.436282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:29.436282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.436282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.440511 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 293/578] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:29.441313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.453889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.454503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.454777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.455048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.455682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:29.456014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.457376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.474475 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 286/579] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:29.474475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.551647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7b83-11d3-48ae-8ec8-bfdd52f4558e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.568599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.581116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607858-9e31-4d19-ad94-f7e298aed579 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.586824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.587432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.587705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.588298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.588871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:29.589171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.591058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.613979 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 294/580] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:29.613979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.620604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.621225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.621495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.621756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.622418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:29.622710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.624104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.632519 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 287/581] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:29.637618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.650003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.722628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505fa9c-bae6-42d5-a91f-d806f49c2492 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.743958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e6da-2f17-43a0-9b6b-b0fae2804d13 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.759473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.760390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.760852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.761264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.771667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.773227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.777901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.778531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.778803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.779062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.785943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.787356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:29.788794 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.789955 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:29.791599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:29.791599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.791599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:29.792108 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 295/582] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.792805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:29.806885 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.807892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:29.808825 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 288/583] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.809345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.827017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.885702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:29.903531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106362e2-db2e-4428-8a4d-0bcdae7d6f26 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.919063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca869-9829-4dec-83ec-84cc9403f058 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:29.941668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.942521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.942959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.943220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.953983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:29.954429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.954615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:29.954900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:29.955150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:29.955944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.966493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:29.967942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:29.970763 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.971732 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:29.972768 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:29.972768 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.972768 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:29.976662 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 296/584] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.977474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:29.982708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:29.983677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:29.989235 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:29.989235 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:29.989235 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:29.989235 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 289/585] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:29.989235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.065615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.088293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b19e7-63da-4938-9aa1-d6b945c826c2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.090424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e593-951b-48dc-9c55-a37ec4cf5b53 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.113428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.125514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.126135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.126325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.126468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.126670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.127091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.127319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.127479 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.127623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.127879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.128623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.128982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.129078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.130486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.141405 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 297/586] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.142290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.147650 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 290/587] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.148667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.250794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9b5f-f75b-486c-a46d-eabf877e1529 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.257148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1593f5-948c-4fc7-a0ed-398f48a92706 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.287911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.288531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.288807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.289076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.289723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.290020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.291880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.303678 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 291/588] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.304526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.310355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.311214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.311639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.312181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.313019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.313465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.315669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.329542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.339847 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 298/589] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.340806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.353916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.413909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950810a7-3092-447d-b0c5-889ff99436e2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.448465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.449117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.449384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.449647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.451991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f45cbc-5f00-42e3-9f48-d1a47b218380 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.457205 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.458657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:30.470054 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:30.471012 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:30.472040 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:30.475929 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 292/590] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:30.476767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.488105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.488761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.489194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.489492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.504877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=cafb054c1ff2433ca610bd9b50466720, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.506209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.521487 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 299/591] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:30 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:30.522872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.584371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dda6f-5347-4769-9dab-4111f716d3e1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.586328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.613470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.631125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.631795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.632078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.632346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.642945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.645564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:30.660876 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:30.661907 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:30.662862 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:30.665423 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 293/592] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:30.666980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.690652 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8a3be-e2b4-468b-bb89-f3a94c37349c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.747633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.748305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.748583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.748851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.759457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.761316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:30.773643 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:30.774575 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:30.775730 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:30.778477 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 300/593] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:30.779547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.790263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412289-377c-4c5b-a184-3f042763795d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.827906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.828575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.828853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.829155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.829904 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.830207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.831982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.851814 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 294/594] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.853010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.877012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.890426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66ed3-7aea-4083-9167-f3a50ad5be48 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:30.903381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:30.930668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:30.932025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:30.932500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:30.933004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:30.934052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:30.934546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:30.936239 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:30.959976 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 301/595] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:30.961216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:30.964903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e3d7-02a6-45cf-8af7-503357651182 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.002307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.002932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.003209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.003888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.004227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:31.005317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.006781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.024494 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 295/596] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:31.025210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.088702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e983c-a319-4898-85e3-2a9dce3e37f1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.115162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.136971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885463-dbaa-4657-b0aa-5ec062042476 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.138845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.140661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.141091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.141541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.158200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.161215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.174252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.175245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.175368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.175711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:31.182879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:31.184169 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:31.185284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:31.185284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:31.185284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:31.187550 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 302/597] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:31.188964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.190385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.192388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:31.211305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:31.212557 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:31.213843 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:31.213843 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:31.213843 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:31.213843 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 296/598] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:31.213843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.221636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.310257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88126d2-0bd1-49b1-a56d-d67e5e6ab6b6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.329655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fe40-fa31-4499-afe7-ff6ad44c4bc0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.347624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.348457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.348834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.349202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/6b5bfa3fddfc4d1cb865331a2f5e4d0e/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.359659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.365217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=6b5bfa3fddfc4d1cb865331a2f5e4d0e, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.366387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.366669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524d71c-2a44-4a6a-a60d-677222a45808 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.367188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.367575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.367974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.368895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:31.369349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.371339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.383834 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 303/599] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:31 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/6b5bfa3fddfc4d1cb865331a2f5e4d0e/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:31.385315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042350-cd99-4863-9f9a-19057ccbdb01 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.385685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042350-cd99-4863-9f9a-19057ccbdb01 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.386013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042350-cd99-4863-9f9a-19057ccbdb01 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.387796 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 304/600] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:31.388323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a042350-cd99-4863-9f9a-19057ccbdb01 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.393556 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 297/601] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:31.399777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.477104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.516008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a042350-cd99-4863-9f9a-19057ccbdb01 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.532565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4dcc-7fe1-4fa5-901c-e6f199253269 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.553880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.554513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.554796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.555064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.555725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:31.556140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.557866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bc4d1-655f-45a3-ad1d-6d7f1cf58225 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.572724 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 305/602] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:31.575780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.575780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.575780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.582908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.583559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.583948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.584221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.592390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.593857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.596728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:31.598026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:31.605868 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:31.606967 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 298/603] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:31.608082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.672411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.690889 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 306/604] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:31.692129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.724702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471e2e-d58e-42ae-98ca-aa2c0561aebb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.758997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.760245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.760726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.761203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.766631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.768781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.770642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:31.782821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:31.783935 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:31.784905 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:31.786808 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 299/605] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:31.793420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.815054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0b45-87ab-4c67-bde7-459e7621454a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.860514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.861132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.861409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.861689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.862393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:31.862699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.864839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:31.878063 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 307/606] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:31.887586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:31.913289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2cc6-9cc0-4c85-8a9b-35e9932bc852 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:31.929248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.973201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:31.973820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.974099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.974370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.975076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:31.975377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:31.976849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:32.006261 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 300/607] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:32.012418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.071008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1b393-77e4-45e8-b988-3baabb4a728d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.095238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:32.115196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.115900 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.116176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.116456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/244d9918798e46afac5635b7374e0ad0/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.132714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=244d9918798e46afac5635b7374e0ad0, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:32.134192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:32.149996 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 308/608] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:31 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/244d9918798e46afac5635b7374e0ad0/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:32.155134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313a21-3f90-43b8-a500-19541262d714 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.156408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.200436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.201604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.202106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.202635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/3bc1abc667b4456d89f42912085211e5/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.239117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=3bc1abc667b4456d89f42912085211e5, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:32.241079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:32.266334 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 301/609] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:32 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/3bc1abc667b4456d89f42912085211e5/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:32.355104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a58c-76cc-4724-a208-a368c216c95d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.399940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.400771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.401179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.401531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.413795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-40e2764d-b7bb-4349-bfc5-6fc283c0f39f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:32.420474 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:32.421701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:32.422806 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:32.424759 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 309/610] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:32.431073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.461194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:32.512110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d549-98a1-4e39-a92f-a471b9c0434d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.512456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d549-98a1-4e39-a92f-a471b9c0434d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.512731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d549-98a1-4e39-a92f-a471b9c0434d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.514239 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 310/611] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:32.521067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.521464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.521836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.550379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:32.552417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:32.553780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f153b6-c285-4d26-9cdd-b1c8cf2c6869 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.585415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:32.633031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.634028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.635950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.636666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.637949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:32.639356 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 311/612] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:32.639889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:32.641541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:32.651132 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 302/613] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:32.656300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.800420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b207cb5-43ce-44f6-8579-5efe585b2655 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.845902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.846731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.847099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.847469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.858571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:32.860256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:32.874871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:32.876101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:32.877212 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:32.877212 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:32.877212 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:32.878689 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 312/614] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:32.883973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.993614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.010233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb613f-d1d5-4502-89a6-68d626b58d6f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.050719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.051768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.052272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.052738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.053586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.054100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.055661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.059698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.069768 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 303/615] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:33.075323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.095959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.235722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7d71-4a14-4ab5-92ba-cc0f07244cef None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.256568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7197c-79d0-42bb-9f7a-18a795e77c8e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.271335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.272171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.272554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.272930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.285249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:33.292102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:33.293160 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:33.294107 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:33.301699 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 313/616] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:33.302175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.352717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.353882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.354421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.354844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.376971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.378689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:33.409025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:33.410179 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:33.411353 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:33.413537 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 304/617] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:33.418410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703a21-3655-4b84-9171-38c1620f6cd4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.419441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.443771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.443969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.453686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.454592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.454977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.455350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.456546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.456955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.458580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.468735 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 314/618] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:33.474121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.579487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2e0f8-8faf-4b6c-9a01-5df9afd29f4a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.610066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.610800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.611318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.611435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.627904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.627904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.627904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:33.643766 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:33.644949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:33.646048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:33.646048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.646048 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:33.646048 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 315/619] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:33.651762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.655953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297d741-24f0-4598-8e61-7203b7507955 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.726523 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.728416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.728868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.730368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.732227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.733336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.737287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.779879 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 305/620] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:33.781302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.808506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e772-6bc6-4a2f-a11b-b9c88fbfe77b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.845638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.846334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.846617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.846888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.847599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.847933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.849536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d7217-2b74-43f1-aa70-8c2e38b83944 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.851310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.868747 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 316/621] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:33.870833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b099e6-98d2-4aa8-96c8-fe36a5d55d8c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.871121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b099e6-98d2-4aa8-96c8-fe36a5d55d8c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.871390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b099e6-98d2-4aa8-96c8-fe36a5d55d8c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.873158 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 317/622] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:33.873856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b099e6-98d2-4aa8-96c8-fe36a5d55d8c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.891045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac887d3-a170-4427-bdc0-884621ce5dd6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.926181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.926949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.927287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.927656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.932697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.938801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.940781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6e45cfd2-016e-48dc-b83c-78c377fabf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:33.956278 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:33.957536 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:33.958581 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:33.958581 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.958581 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:33.958581 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 306/623] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:33.959543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.959938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.960391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.978319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:33.979790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:33.997271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b099e6-98d2-4aa8-96c8-fe36a5d55d8c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.034784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.035775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.036258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.036706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.045459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.047224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.051786 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 307/624] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:34.051786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:34.073912 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:34.075179 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:34.077284 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 318/625] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:34.082134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.107889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.163594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676b64-18ef-4faa-9368-3ee895abc793 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.199640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.200302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377d04-2b43-4895-a0cf-b21cbd8dd3e7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.201262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.201825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.202311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.203194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:34.203720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.205287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.207719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.219713 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 308/626] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:34.226102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.248764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.249817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.250288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.250785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.251733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:34.252432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.254639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.275514 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 319/627] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:34.281291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.389077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8d4d-a06f-4b22-a8fd-b32f9c7c0e91 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.426749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.427731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.428291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.428884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.461714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.474616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24c305-0fef-4eb0-ad62-ef46bacc1e8a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.477238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.504848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.506881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.510997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.511633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.511949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.512216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.519067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.520571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:34.531798 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:34.532740 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:34.533634 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:34.537537 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 309/628] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:34.538280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.616423 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 320/629] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:56:34.617712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.637871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c15c-14ef-46d9-af9d-b1d9a8b3c056 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.670794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.671337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.671607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.671886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.678699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.682731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-59fa08c9-761e-445a-a059-63fc8cd1ea90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:34.687821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:34.688904 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:34.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 310/630] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:34.690443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e567c-735d-4e5d-8931-6269e208c609 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.690443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e567c-735d-4e5d-8931-6269e208c609 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.690832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e567c-735d-4e5d-8931-6269e208c609 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.692238 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 311/631] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:34.693315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805e07-555c-401c-9f54-d9fa503e4565 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.693754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805e07-555c-401c-9f54-d9fa503e4565 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.693979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805e07-555c-401c-9f54-d9fa503e4565 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.695141 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 312/632] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:34.695921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805e07-555c-401c-9f54-d9fa503e4565 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.721074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.724828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ecd5e-bb02-4172-9bfb-2912675b52b4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.760449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.761056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.761328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.761592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.762280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:34.762583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.764042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.775200 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 321/633] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:34.776244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.803026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805e07-555c-401c-9f54-d9fa503e4565 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.836232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.836890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.837171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.837434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.848270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.849728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8debb6bf-028b-4f25-a14d-dcc8e005f779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:34.863665 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:34.864625 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:34.865533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:34.865533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:34.865533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:34.865533 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 313/634] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:34.866089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.866366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.866637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.875666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684897ef-42ae-442c-8b38-bf4555624c89 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.884628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:34.886330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:34.898181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.909247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.909851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.910206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.910473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.911129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:34.911424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.912830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dadd4-70d4-4822-bee7-283cbd23f171 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.921122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 322/635] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:34.922290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.922566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.922840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.941162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:34.942370 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:34.957786 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 314/636] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:34.958483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.979596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.016610 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 323/637] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:35.017274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.088382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62ea5-f17d-4bd7-95c3-5ad7a8fee769 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.132968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.134242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.135108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.135631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/9842b5bcc876492e9e765c86a3ba3138/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.138373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87980a81-1ac2-474f-a030-7dbf25cd3d06 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.155768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.157707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=9842b5bcc876492e9e765c86a3ba3138, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.159399 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.183863 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 315/638] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:34 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/9842b5bcc876492e9e765c86a3ba3138/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:35.183863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.189044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.189676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.189945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.190212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.190869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.191169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.193382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.230613 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 324/639] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.231858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.272540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.323753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335012-efff-494a-ae5b-1775675eb74b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.359696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89fade-200a-410c-8474-dc4b04a9e24d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.363041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.363678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.363977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.364244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.374680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.376160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:35.391206 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.392419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:35.393350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:35.393350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:35.393350 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:35.393350 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 316/640] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.393593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.401758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.402396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.402694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.403394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.414774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:35.420741 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.421707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:35.422565 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 325/641] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.423256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.466250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.503308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2016-4b9b-4df4-a086-fb0917fc7d53 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.514033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.540990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.541945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.542215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.542674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.545278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357b25-4248-4b67-80b0-aebc57ee4e63 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.549519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.550951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:35.562366 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.563484 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 317/642] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.564438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.586743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.587374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.587715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.588634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.599387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:35.606967 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.607965 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:35.608916 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 326/643] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.609733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.675933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75a12-7326-4341-9df2-e91cd2af4410 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.711875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.715079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.715731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.716026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.716335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.716944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.717239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.718609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.719446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a698-e298-4639-babb-92b990340e33 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.735321 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 318/644] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.735321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.761063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.761671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.761938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.762200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.762870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.763168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.764585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.766501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.777907 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 327/645] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.777907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.854417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcbe60-7412-4b21-8e5b-04977ed123f8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.890496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.891108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.891384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.891665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.892393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.892698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.894129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.894744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5370-e391-432b-9c0a-e95ac96ea2ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.911785 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 319/646] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.911785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.934292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.934907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.935189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.935458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.936165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.936466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.937849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.951576 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 328/647] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.951576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.974676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.003233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.017131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e521ce-aeba-4c9b-9d22-6e43dac6e7c1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.052141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.052789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.053061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.053327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.056520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bff38-49a3-41d9-8f6f-12d967090fcb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.061738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.063248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:36.075245 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:36.080985 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 320/648] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:36.081977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.098955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.099799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.100088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.100456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.116083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.117668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:36.133352 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:36.134379 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:36.135369 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:36.135369 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:36.135369 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:36.135369 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 329/649] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:36.136147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.191832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a125-867c-4195-a61b-568cbaf0055c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.216533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.230008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.230550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.230820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.231088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.231959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.232267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.233807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.248089 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 321/650] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:36.248089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.257410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3106-ab90-4f4c-8bee-ed845c5ee30c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.263462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.308679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.309688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.310038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.310374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.326983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.328651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:36.349776 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:36.350821 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:36.351724 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:36.351724 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:36.351724 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:36.351724 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 330/651] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:36.352702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.380147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee2b3c-58ca-4936-95cc-fef8c407f124 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.431689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.432462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.432800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.433299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.434057 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.434363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.436480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.454837 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 322/652] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:36.455792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.490135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13e0f1-4d62-4717-bdff-df7881e093a9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.522111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.536310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.536924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.537196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.537460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.538101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.538396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.539811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.552036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.561028 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 331/653] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:36.561028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.589999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4aca9-8d26-4fcf-9a44-0588307b5f1e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.624354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.624977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.625272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.625493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.626140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.626433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.627946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.640481 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 323/654] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:36.644735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.690121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7afe03-77a6-4ec8-931e-ef95370150db None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.727032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.727689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.728053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.728325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.766828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2cea-bdc6-46d4-869b-1497e54ec193 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.783067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.800829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.802374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.815483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.816776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.817264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.818014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.824126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.832311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.834691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:36.851455 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:36.852549 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:56:36.853612 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:36.856850 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 324/655] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:36.857870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.918547 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 332/656] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:36.919401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.987387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589795-bd76-4646-b5de-6066de7b6d68 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.022337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.022838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.023164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.023433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.025975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.032384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.033885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:37.046744 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:37.047804 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:56:37.048785 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:37.050357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299435d-e836-46ac-9b60-b5c718db9af7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.052145 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 325/657] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:37.052865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.096492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.097922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.098555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.099127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.100378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:37.101366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.103409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.104990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.130562 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 333/658] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:37.131436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.175692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1c9d-9157-4937-ab7e-994d6549a6fe None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.216962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.217597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.218259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.218533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.231318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.232822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.241297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6698a-77fa-431c-90ab-9465764ef2ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6ae0aaad-69ce-469c-83e5-d5439a44b20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:37.251081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:37.252401 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:37.253356 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:37.253356 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:37.253356 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:37.253356 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 326/659] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:37.254534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de747b-48e8-4f17-a2f0-14fca8df645f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.254826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de747b-48e8-4f17-a2f0-14fca8df645f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.255102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de747b-48e8-4f17-a2f0-14fca8df645f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.256946 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 327/660] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:37.257650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de747b-48e8-4f17-a2f0-14fca8df645f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.282417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075360bd-8710-40cc-bc74-51531668663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.282965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075360bd-8710-40cc-bc74-51531668663a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.283208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075360bd-8710-40cc-bc74-51531668663a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.283476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075360bd-8710-40cc-bc74-51531668663a None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.284263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075360bd-8710-40cc-bc74-51531668663a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:37.284555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075360bd-8710-40cc-bc74-51531668663a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.286020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075360bd-8710-40cc-bc74-51531668663a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.302310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.306194 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 334/661] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:37.307339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075360bd-8710-40cc-bc74-51531668663a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.378495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de747b-48e8-4f17-a2f0-14fca8df645f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.380063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.414349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.414957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.415233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.415501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.429496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075360bd-8710-40cc-bc74-51531668663a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.467194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.467833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.468113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.468380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.469449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:37.469816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.471765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c9384-ae7d-40d0-9008-0a657394a39f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.485458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.486938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.492724 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 335/662] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:37.492724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.492724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.492724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.510587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:37.511930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:37.575305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.587644 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 336/663] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:37.588289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.621066 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 328/664] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:37.622582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.624973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.696502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824fbfe-e429-4a9a-a55b-1575297ceee2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.736217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.737474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.737912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.738334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.752470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9674-e1a6-4d89-8ba9-ca7fac318263 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.788471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.789477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.789874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.790242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.798068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.799678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:37.811471 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:37.812734 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:37.813959 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:37.818479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.820369 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 329/665] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:37.821302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.832706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.835311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:37.886957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:37.929236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd7e-7f80-40ee-b237-c535a0085eb9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:37.944685 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 337/666] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:37.945808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:37.970488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:37.971127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:37.971408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:37.971678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:37.982880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:37.984366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:38.000151 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:38.001193 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:38.002173 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:38.002173 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.002173 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:38.002173 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 330/667] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:38.002852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.042701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.054288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee87f-9a03-41a0-8d91-3f615b649573 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.090158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.090702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.090959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.091226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.091971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.092265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.093711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.105798 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 338/668] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.106610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.125157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e9c08-b17f-49ae-b483-e25b8db0d162 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.139935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.162147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.162778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.163052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.163314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.174599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:38.179720 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:38.180700 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:38.181678 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 331/669] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:38.182458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.219477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58cb4-a7c3-4e41-b66b-88cb66f5c576 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.253396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.254019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.254287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.254614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.266062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.267555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:38.283127 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:38.284595 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:38.285496 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:38.285496 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.285496 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:38.285496 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 339/670] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:38.285496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.289424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488d2bc-8278-43bf-b796-54e4ff60158f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.293131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.329096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.329734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.329981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.330245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.330881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.331175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.332568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.349879 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 332/671] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.349879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.378763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.398091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c36d-9a53-4370-aff1-407f217b662a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.431037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.431929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.432200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.432462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.433186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=6b5bfa3fddfc4d1cb865331a2f5e4d0e) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.433485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.434921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.448482 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 340/672] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/role_assignments?user.id=6b5bfa3fddfc4d1cb865331a2f5e4d0e&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.448482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.448823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92ef8-1dbe-443c-85d0-d389eee45544 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.483981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.484598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.484889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.485142 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.485834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.486118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.487541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcd66-0a69-4f27-bdbe-d86b4da498a3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 333/673] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e603e-1ad2-489e-b947-52d6e875e5d6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e603e-1ad2-489e-b947-52d6e875e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e603e-1ad2-489e-b947-52d6e875e5d6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 334/674] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:38.501990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e603e-1ad2-489e-b947-52d6e875e5d6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.533839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.582572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6d29-5ac0-4fa8-9835-a85d52687d82 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.614383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.624059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e603e-1ad2-489e-b947-52d6e875e5d6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.627179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.627857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.628143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.628463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.629068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.629364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.630759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.643450 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 341/675] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.644384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.665930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.667046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.667379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.667712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.675096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.676565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d66bb608-1ffa-4ff8-81f7-5ce54a7b7ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:38.688130 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:38.689146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:38.690059 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 335/676] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:38.691402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.691875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.692331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.711867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:38.713312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:38.757699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4997-da73-4576-9aab-a627e586bc78 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.783461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.793768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.794451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.794722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.794987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.796101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 336/677] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:38.796897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.806098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.807789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:38.823911 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:38.824961 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:38.825857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:38.825857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:38.825857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:38.829912 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 342/678] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:38.830749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:38.913630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:38.936143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec04851-0365-4fbf-864d-20da1929e6a9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.938787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4b02-ba89-43c8-a426-bda3f71fa7dc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:38.975161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.976159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.976631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.977103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.977983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:38.978568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.981512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.982788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:38.983692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:38.984014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:38.984286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:38.993034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:38.995103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:38.996547 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 343/679] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:38.997640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:39.017257 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:39.018249 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:39.019188 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:39.023416 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 337/680] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:39.024298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.048418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.109902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d39a-041a-4f22-9d7c-aa89e061a6e8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.137466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d3cf-fe68-464d-91fc-9c084df8a2a5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.144940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.145552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.145828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.146089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.146732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.147025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.148422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.165056 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 344/681] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.165056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.179009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.179616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.179917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.180179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.180902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=244d9918798e46afac5635b7374e0ad0) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.181227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.183013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.188722 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 338/682] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/role_assignments?user.id=244d9918798e46afac5635b7374e0ad0&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.188722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.213315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.290896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.301511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c458a8-0e40-4527-a8a6-b73efd6d2283 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.323002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65b82-33e0-4cbd-8611-56f7ef8534f2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.341369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.342428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.342852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.343270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.344158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.344622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.346559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.366093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.366644 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 345/683] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.366947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.367314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.367679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.368283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.382197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:39.388964 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:39.390081 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:39.391122 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:39.394159 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 339/684] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:39.394159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.484725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.505519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431751c-479b-4020-a282-bd1f08c61953 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.518026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c9d4-614c-4930-85cd-d394c8b31435 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.540735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.541790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.542115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.542387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.550021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.551497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.555950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.556853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.557195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.557529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.558387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=3bc1abc667b4456d89f42912085211e5) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.558759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.560307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:39.563490 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:39.564688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:39.565837 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 346/685] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:39.568623 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 340/686] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/role_assignments?user.id=3bc1abc667b4456d89f42912085211e5&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.570232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.571216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.591490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.762993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e11d-37c1-4f5e-8b20-6fc20348c8e5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.767238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375109c5-8b99-43cd-96f4-9b6c2fac136d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.808967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.809676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.809956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.810212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.810950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.811308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.812265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.812760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.812874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.813147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.813418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.814093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:39.814397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:39.814620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.816914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:39.828744 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 347/687] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.834177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.836196 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 341/688] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:39.841802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.922278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.944063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e73f-9928-4f1c-8fa6-cd8016bd652d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.952446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d418fc-0601-42fd-98a1-cd764c1aa228 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.990379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.991023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.991294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.991557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.008575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.009196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.009524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.009794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.012642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.016247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:40.052828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.053864 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:40.055435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:40.055435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.055435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:40.055435 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 348/689] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:40.059607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.079873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.091676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.093172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.199030 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 342/690] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:40.205650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.266667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862d07-c154-4ead-a047-2f141e3ee949 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.317062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.330241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.331013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.331408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.331795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.332555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.332954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.334443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.366173 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 349/691] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:40.371289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.373046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.383420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cd63-1abe-4453-a8b3-9d49b500e514 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.427914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.428927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.429342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.430545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.453930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.456703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:40.492380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.493655 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:40.494824 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:40.494824 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.494824 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:40.501347 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 343/692] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:40.508705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.560029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0974a3-f02e-47fd-87e0-4658be373c68 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.604898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.606236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.606905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.607315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.615882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.617335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.628049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc2f-6c6f-4332-ae39-d36f871c23d5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-33b860d4-772a-4189-bb4d-29f1b548b1a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:40.629274 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.630396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:40.631530 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 350/693] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:40.632201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fa7-7665-4a24-a7e8-b3af7240a1a4 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.632201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fa7-7665-4a24-a7e8-b3af7240a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.632412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fa7-7665-4a24-a7e8-b3af7240a1a4 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.634537 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 351/694] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:40.641028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.641511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.641615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.659600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:40.660797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:40.670765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.672024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.672853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.673283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.674373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.674815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.677116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.698452 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 344/695] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:40.699895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.705612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.717003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.742987 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 352/696] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:40.744311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.825315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3a83-986e-4bf4-b599-72b561b55ce0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.862247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.863311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.865197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.866398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.867296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.868528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.871507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.899239 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 345/697] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:40.905702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.976598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ea6b-b548-4b3a-ae3d-dd14eb217cf7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.999108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.042893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297920a6-003c-46e6-b58e-a40fde6fd164 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.044755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.045499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.046383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.046383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.064620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.066205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.078598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.079431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.079907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.080390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:41.083843 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:41.084949 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:41.086083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:41.092003 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 353/698] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:41.093861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.159420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.161393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.162485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.232078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.244182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb5af-22ed-43ac-8fbe-a4899d6ecad9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.285647 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 346/699] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:41.285647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.289815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.290810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.291700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.299194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.300774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.301312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.302994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.316422 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 354/700] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.317604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.395517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404568b-b52d-4e32-981b-8edf0bf38cb6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.427787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd575c6-92b0-469b-a561-af1c55b28d22 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.429733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.429892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.430366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.430641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.430915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.441385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.442838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:41.458172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:41.459298 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:41.460779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:41.460779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:41.460779 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:41.460779 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 347/701] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:41.460779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.474611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.475249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.475524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.475814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.477567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.487568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.489051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cf221480-fbcf-431d-b1aa-9d973bb1d4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:41.506388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:41.507452 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:41.508434 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:41.508434 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:41.508434 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:41.509419 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 355/702] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:41.511086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4f22-efc4-44ee-a5d5-86236b9efc13 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.511428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4f22-efc4-44ee-a5d5-86236b9efc13 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.511798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4f22-efc4-44ee-a5d5-86236b9efc13 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.513273 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 356/703] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:41.514197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4f22-efc4-44ee-a5d5-86236b9efc13 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.570421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fa2b-d228-46b9-9a50-8ef02e1e879c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.606158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.606769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.607042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.607413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.608282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=9842b5bcc876492e9e765c86a3ba3138) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.608590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.610023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.616040 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 348/704] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/role_assignments?user.id=9842b5bcc876492e9e765c86a3ba3138&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.616810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.654746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4f22-efc4-44ee-a5d5-86236b9efc13 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.696714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.697450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.697723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.698111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.698773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.699071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.700709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9290e-b215-4c5a-a063-43b6db509963 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.717597 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 357/705] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.719158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.719514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.719804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.735151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.743156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:41.745591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:41.759700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.764894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4faef-2c90-4ace-8604-66559443c80d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.803801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.804561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.804907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.805244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.806007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.807191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.808695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.821785 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 349/706] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.822807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.831825 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 358/707] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:41.832968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.942166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c113e-6cde-49ab-ad59-01d67aaed851 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.966408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1c607-2bd9-4061-a659-b5d73ee66a16 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.979553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.980300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.980638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.980988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.981687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.983203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da68e77-54d5-469d-8f6d-563b2f83d3d9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.993894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.010596 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 350/708] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:41 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:42.011630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.012075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0379ea-ff26-442b-93d1-5f90c9663af7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.012419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0379ea-ff26-442b-93d1-5f90c9663af7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.012749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0379ea-ff26-442b-93d1-5f90c9663af7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.013176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.013669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.014113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.014522 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 351/709] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:42.020990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.021361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.021559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.026388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.028367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.043455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:42.044702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:42.045528 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:42.046463 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:42.047437 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:42.049236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 359/710] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:42.060333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.064438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.129980 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 352/711] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:42.148888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.264902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a745-60c9-4d5f-9db9-c4896d81e34a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.313189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.313810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.314081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.314345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.315041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:42.315336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.317607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.322402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8929-66e4-4b0b-bd74-102cc493eefa None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.333841 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 360/712] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:42.339650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.353967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.374299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.376094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.376538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.377340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] PATH_INFO: `/v3/services/network` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.378355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.380841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:42.396095 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:42.397466 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:42.398526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:42.401246 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 353/713] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:42.408342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.424481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.477266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fba3-135b-4c3d-934d-2ca12980fa0c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.515074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.516219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.516637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.517043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.517922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:42.518387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.519986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.526332 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 361/714] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:42.531456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.565746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1fba-2557-4d54-a58c-d68686805e34 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.643462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.644245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.644522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.644789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.645504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:42.645802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.652549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.673528 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 354/715] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:42.681790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.729885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f4d7-d82e-4c1c-afc0-b1463944527b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.758579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.768450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.768768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:42.769018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.769297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.769567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.770499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.771942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:42.784288 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:42.785358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:42.786214 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 362/716] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:42.792541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:42.843249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce749baa-35b4-48c9-886d-245f768c77e5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.911903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aef9e-cfa7-43ff-900c-7e64923dbe34 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:42.949356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.950708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.951183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.951660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.952532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:42.953035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.954585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.956786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:42.957488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:42.957772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:42.958031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:42.958726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:42.959013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:42.964440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20a7f-a6af-459d-b621-2ed149f0dcdf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:42.968374 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 355/717] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:42.978299 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 363/718] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:42.984248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:43.123374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d5e38-8acd-49e8-a622-401da182d3c4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:43.145694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:43.172991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:43.174035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.174507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.174965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.175817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:43.176325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:43.177900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097b503-7063-4414-9c3c-30374b0e6630 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:43.187800 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 356/719] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:43.798838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369bb7-6eb9-4123-b527-32f6371e02d7 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.799915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369bb7-6eb9-4123-b527-32f6371e02d7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.800409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369bb7-6eb9-4123-b527-32f6371e02d7 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.801997 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 364/720] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:43.807979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.808501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.808965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.838818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:43.840380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:43.932533 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 357/721] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:44.377965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369bb7-6eb9-4123-b527-32f6371e02d7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.463610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.514233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369bb7-6eb9-4123-b527-32f6371e02d7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.560101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.560653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.560929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.561194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.580804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b589547b-7e44-4f8a-ab19-f416e79fbb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:44.585654 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:44.586603 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:44.587518 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:44.588654 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 365/722] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:44.593588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.628103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6e21-a917-40f1-9207-ac9c0a598de8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.628417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6e21-a917-40f1-9207-ac9c0a598de8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.628641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe6e21-a917-40f1-9207-ac9c0a598de8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.630215 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 366/723] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:44.635502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.635932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.636287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.660905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:44.662104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:44.772179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44b1bb-6432-4c28-8c42-7bbb9fe2ca78 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.787660 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 367/724] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:56:44.798600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.857365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.857920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.858200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.858469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.859163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:44.859458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:44.860878 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453c803-adb9-4b2e-aa4e-71fad38634f2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:44.876483 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 358/725] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:44.882175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.964998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.965507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fdf1-6c3d-4e76-8514-88f9cd726dad None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.965799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fdf1-6c3d-4e76-8514-88f9cd726dad None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.966081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fdf1-6c3d-4e76-8514-88f9cd726dad None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.967633 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 359/726] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:44.985536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.986123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.986599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.023519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:45.025127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:45.026269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a0bcf-2a6f-4231-aa63-d940ef6061fc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.067257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.068935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.069219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.069494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.094393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.095906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:45.120433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.121413 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:45.122304 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:45.122304 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:45.122304 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:45.122486 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 368/727] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.126065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.143161 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 360/728] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:45.144082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.250375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.254730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb032ea-5086-4fb4-8d9e-f9a483c05e68 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.301012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.301655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.301931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.302202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.314751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:45.320387 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.321349 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:45.322268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:45.323426 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 369/729] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.329217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.334791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b72b-af3c-457f-b61b-5c60d4349c74 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.336502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.374622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.375239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.375579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.375934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.376648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:45.377029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.378570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a919c7-aeb6-4d92-8ece-f0fd3c24a14d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.391460 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 361/730] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:45.392925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f38ff-7dce-4f23-aeb5-272ae5dd55c6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.393270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f38ff-7dce-4f23-aeb5-272ae5dd55c6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.393607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f38ff-7dce-4f23-aeb5-272ae5dd55c6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.399101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 362/731] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:45.400264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f38ff-7dce-4f23-aeb5-272ae5dd55c6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.448737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db054-8455-4eb9-82bb-18e9585e8771 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.493060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.494081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.494702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.495161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.496567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:45.497059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.499071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdbb53-7e64-4392-b58d-b66343eb754b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.509756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f38ff-7dce-4f23-aeb5-272ae5dd55c6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.515384 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 370/732] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:45.515384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243891-0f2f-485c-ae79-249aff706387 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.515384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243891-0f2f-485c-ae79-249aff706387 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.515384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243891-0f2f-485c-ae79-249aff706387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.537309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-81243891-0f2f-485c-ae79-249aff706387 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:45.538494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-81243891-0f2f-485c-ae79-249aff706387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:45.549880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.550558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.550849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.551127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.553440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.560749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.562214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:45.573912 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.574863 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:45.575859 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:45.579752 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 363/733] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.580574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.604373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.614875 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 371/734] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:45.623420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81243891-0f2f-485c-ae79-249aff706387 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.704855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8911df-d572-4e7f-b997-f065d3b1bc5b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.716186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81243891-0f2f-485c-ae79-249aff706387 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.750990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.751374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.751680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.751978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.752079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.752251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.752345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.752505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.762837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:45.764020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.765469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:45.767566 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.768599 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 372/735] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.769466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.782776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d0dabc99-c639-42ef-b703-c8d585122a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:45.786595 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:45.788840 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:45.788840 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:45.788840 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:45.793592 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 364/736] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.794863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006eabd-f654-4163-a908-d5676081ab75 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.795143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006eabd-f654-4163-a908-d5676081ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.795413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006eabd-f654-4163-a908-d5676081ab75 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.796898 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 365/737] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:45.797450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006eabd-f654-4163-a908-d5676081ab75 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.875267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.888672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46498ba0-9e66-4467-acc7-dcadc268d7a7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.904262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006eabd-f654-4163-a908-d5676081ab75 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.926081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.926708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.926972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.927240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.928021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:45.928324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.929775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.938903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.939547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.939824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.940093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.940765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:45.941065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.942414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f64ff-318b-4899-9431-c6b77a897207 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.947621 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 373/738] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:45.948599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.956113 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 366/739] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:45.956113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.956113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.956113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.970804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:45.972008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:46.019388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.037047 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 367/740] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:56:46.037879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.058383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37535-f375-4ec3-af7d-2c8b31afa21b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.094573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.095178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.095448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.096020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.096378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.096693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.098064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.109575 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 374/741] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:46.110395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.110507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.148712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b769f4-9181-49b9-b2d6-90d2ff0377cf None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.187826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.188454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.188728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.188996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.189772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.191166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.209091 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 368/742] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:56:46 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:46.210179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.244609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ce66-ef0e-4ffb-af51-b5eb1e524189 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.290846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.309259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.309883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.310153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.310418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.352451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f922-18e5-484f-a1b9-8663da00f346 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.383763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.383996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.385092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.395528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.396402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.396520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.396718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.412328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.413790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:46.430542 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:46.432234 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:46.433133 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:46.433133 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.433133 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:46.433133 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 369/743] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:46.433562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.499296 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 375/744] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:56:46.500443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.526638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.547704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca75b1-a9be-472d-8ab2-8e7e9ac455cd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.581962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.582598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.582875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.583145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.591088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.592564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:46.603987 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:46.605419 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 370/745] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:46.606378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.615114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54194e79-ffc1-4d0e-ab01-4a8f44ffb5e3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.649039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.652435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.653224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.653570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.653906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.654624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.656121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.673874 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 376/746] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:56:46 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:46.674770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.733920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c69eb-d47e-4672-8526-ff0a64fa7ced None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.786154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.786702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.786981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.787251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.787947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.788255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.789677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.789869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.804755 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 371/747] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:46.805751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.811837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712669-dc2a-4e7d-86b8-d6a9738873d0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.852327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.853311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.853750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.854291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.868407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.870227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:46.886952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:46.888117 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:46.891080 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:46.891080 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.891080 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:46.891080 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 377/748] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:46.891080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.917158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.926256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576933b-a7b6-4216-a517-c0a71da90f9a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.966744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.967460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.967753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.968029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.968771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.969071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.970566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.989481 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 372/749] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:46.990338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.011425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3717-98d9-4d0d-b0e0-4db03466510a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.049504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.050062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.050439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.050716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.053710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.060766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.062331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:47.075393 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:47.076423 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 378/750] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:47.078356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.098522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75184a5-fa8e-42a9-88bb-74ae3a99d776 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.135600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.136271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.136586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.136858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.137511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:47.137808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.139181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.152077 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 373/751] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:47.152978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.174689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.205706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10f9bc-2f88-4bf7-8651-14a8d5dfbd6e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.250357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.250974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.251256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.251525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.293860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41bdf-410e-499a-aed5-6f51aaaedf66 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.334855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.335526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.335989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.336244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.337054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:47.337471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.339383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.343129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.351254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.353317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.361115 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 374/752] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:47.362160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.432993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.464003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe04b-e52f-4228-be89-3d384ca3925e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.467081 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 379/753] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:47.468266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.499207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.499872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.500148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.500411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.507063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.508516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:47.519871 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:47.520821 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:47.521733 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:47.525565 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 375/754] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:47.526627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.574322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.581325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bed0-5cc3-4610-9093-d3cfa81dabc7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.619585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.620604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.621084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.621628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.627853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f42db-e00e-46b7-83b9-807d2d018c6c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.633699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.635704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:47.652109 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:47.653191 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:47.654116 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:47.654116 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:47.654116 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:47.656627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.656863 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 380/755] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:47.658182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.664443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.666038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.667164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.667430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.678619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.680103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:47.695066 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:47.696096 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:47.697237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:47.697237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:47.697237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:47.697237 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 376/756] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:47.697959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.772285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f95fb0-8c19-4d96-9c90-94f1b101d964 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.799132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0877f-2bc4-4aa2-8451-ba7d5770352d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.808697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.809667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.810175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.810643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.811568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:47.812089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.813749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.827238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 381/757] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:47.828469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.838680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.839079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.839362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.839795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.840738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:47.841038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.842489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.844092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.857021 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 377/758] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:47.858085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:47.905946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:47.942547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224c78-29f0-4e92-9be6-6cb46bf85597 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.967402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aeb1-b46d-4a2f-86ff-d2016b0ba2d8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:47.981586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:47.982620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:47.983143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:47.983611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:47.984581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:47.985080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:47.986890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:47.999823 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 382/759] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:48.001071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.003319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.004090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.004419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.004701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.005536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=9842b5bcc876492e9e765c86a3ba3138) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:48.006483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.007308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.019903 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 378/760] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:47 2022] GET /identity/v3/role_assignments?user.id=9842b5bcc876492e9e765c86a3ba3138&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:48.020934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.076159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.151772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4d98c-0756-4d08-b28f-4a5544e2f3ad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.219377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.220421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.220699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.220969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.223567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56536c-4be1-4d67-b5b6-5ea04d2a2696 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.228522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.229574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.232434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ce7de815-675b-444d-a80d-ce88489205b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:48.245486 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:48.246433 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:48.247353 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 383/761] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:48.247916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0723-707f-4bf5-891c-1ff1042b55ac None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.247916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0723-707f-4bf5-891c-1ff1042b55ac None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.248529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0723-707f-4bf5-891c-1ff1042b55ac None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.256142 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 384/762] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:48.256956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0723-707f-4bf5-891c-1ff1042b55ac None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.266703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.268252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.268744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.269256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.279171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.281291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-eda4ebd6-6ee1-4a9e-b6fc-cdcbb00c18c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:48.297376 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:48.298320 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:48.299238 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:48.301617 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 379/763] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:48.303052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.303495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.304201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.328798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:48.331178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:48.388843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0723-707f-4bf5-891c-1ff1042b55ac None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.429208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.429621 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 380/764] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:48.430882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.439536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.439536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.439536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.439536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.440068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:48.440068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.440068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.458321 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 385/765] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:48.467368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.617357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.627188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7eb1-b35f-4b70-a54d-ac7a144d84fc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.641869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706199-3b59-4fca-a938-15c2b8b0dca0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.694098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.694772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.694981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.695457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.696182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:48.696480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.697974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.711335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.712025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.712428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.712710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.714651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=cafb054c1ff2433ca610bd9b50466720, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.716197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971805c-c11b-401e-8bdd-e984304de2db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.721981 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 381/766] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:48.728378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.739782 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 386/767] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:48 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:48.741387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbaddf-e2fb-4c56-838e-8dc19999883e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.741881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbaddf-e2fb-4c56-838e-8dc19999883e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.742211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbaddf-e2fb-4c56-838e-8dc19999883e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.744218 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 387/768] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:48.749932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.750259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.750471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.769518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:48.771118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:48.835062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.855054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8380-1dd4-4b7b-872c-cf7b8b82bb36 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:48.871915 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 388/769] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:48.873224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:48.915187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:48.915633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.915980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.916624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.917381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=c94db960d5bd475da8b98ca7c4c699b2) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:48.917654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:48.920092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:48.926575 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 382/770] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/role_assignments?user.id=c94db960d5bd475da8b98ca7c4c699b2&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:48.999321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da802a73-69d7-4f7d-a348-09cd53f4bb8a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.037697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.038357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.038632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.038905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] PATH_INFO: `/v3/services/network` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.039500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.041705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:49.052475 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:49.053545 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.054401 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 389/771] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:48 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:49.060788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.091172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.181270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dbf-4f92-4ca9-b94b-6f71f68b1ba3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.222640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.226493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.227112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.227383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.227659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.228400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.228696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.230068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.239871 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 383/772] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:49.245296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.276015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.396385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9cb4a-2b4b-459a-8b03-ca26284ad04b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.423598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.454303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04403b5a-a096-4092-a4a5-dc997b6336a9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.465965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.466615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.467199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.467474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.468369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.469927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:49.482980 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:49.484046 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:49.484907 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 390/773] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:49.491211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.512870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.513487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.513756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.514020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.514651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.514951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.516340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.528743 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 384/774] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:49.533396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.685508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e146f83-8189-4a20-9cde-c9ad8676290f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.699563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.720929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f333-a733-40c0-b197-2597a9ce13e7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.734102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.734715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.734990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.735253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.735922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.736220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.737595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.742560 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 391/775] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:49.751765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.759177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.760282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.760760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.761043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.761765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] RBAC: Adding query filter params (interface=public, service_id=e7078bfd58a940bab5674cee3ad9721f, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.762062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.763460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.773231 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 385/776] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/endpoints?service_id=e7078bfd58a940bab5674cee3ad9721f&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:49.778735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.801401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.910847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ca06-eb4e-4096-9561-b0f1b4a96294 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.965966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738882-fe23-468f-9f92-6ca83b0a424d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.967992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.968616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.968887 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.969152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.969794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.970091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.971539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.986431 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 392/777] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:49.992298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:50.037334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:50.037955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.038227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.038494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.039110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:50.040573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3be9-72aa-471c-bedd-8b0102238b25 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:50.052591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:50.058978 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 386/778] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:50.178026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dd4dc-dcdb-4ad3-8dab-8dd793d588ba None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:50.222693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef991-81fb-49e4-9f6c-68d495dadbb9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.222882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef991-81fb-49e4-9f6c-68d495dadbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.223136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef991-81fb-49e4-9f6c-68d495dadbb9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.224522 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 387/779] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:50.231716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.232164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.232529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.249072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:50.249863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.250254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.250528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.251256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] RBAC: Adding query filter params (interface=public, service_id=338f288fa7874f67b7dbbfd139823fc8, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:50.251626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:50.253114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:50.254095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:50.255683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:50.267861 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 393/780] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/endpoints?service_id=338f288fa7874f67b7dbbfd139823fc8&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:50.276886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:50.379202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:50.383402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a7e8-a926-4213-85b3-bc985cf18da5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:50.404775 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 388/781] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:50.421647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:50.422268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.422541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.422805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.423418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:50.424833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:50.435893 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 394/782] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:56:50 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:50.732264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:50.740758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:50.839056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b8ad-82dd-4166-a13d-7127a62df04e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:50.874334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:50.875320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:50.875795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:50.876256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:50.887166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:50.892117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:50.893072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:50.893916 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:50.899833 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 389/783] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:50.902313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.005204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6665-b79e-4c7e-ad4d-050aced37145 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.039330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.040250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.040695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.041613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.042430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:51.042868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:51.044431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63998e56-3c5c-4fdf-a131-37ee64cf5344 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:51.056193 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 395/784] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:51.060299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.109141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474a2c4-b855-46de-af20-e3d5e5713687 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.109659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474a2c4-b855-46de-af20-e3d5e5713687 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.110069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474a2c4-b855-46de-af20-e3d5e5713687 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.111545 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 396/785] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:51.116660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.116943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.117228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.134368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.151831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:51.151831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:51.170206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.186721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa10b-a1b8-4d78-b75b-edb0c52d0315 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.247125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.247803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.248089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.248352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.249259 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 397/786] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:51.259174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:51.260572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3cf6f694-9494-4664-b543-9baa82596577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:51.275587 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:51.276597 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:51.277726 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:51.277726 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:51.277726 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:51.277726 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 390/787] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:51.284102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.329905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952001-a833-4e54-80e3-362af1043fbf None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.330229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952001-a833-4e54-80e3-362af1043fbf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.330448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952001-a833-4e54-80e3-362af1043fbf None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.332058 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 391/788] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:51.337408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.337829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.338653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.375215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:51.376439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:51.474766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3085a-0fd9-4dd1-9b58-a5fee06c1dbf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.503600 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 392/789] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:51.528540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.529501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.529997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.530507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.531355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:51.531873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:51.533437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:51.548944 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 398/790] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:51.554705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.598066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.614617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.643551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.705378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa6c3-0002-4728-9476-09d9a29263b8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.744209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.745719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.746168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.746624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.758726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:51.766459 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:51.767713 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:51.768610 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:51.769248 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 399/791] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:51.776574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.779523 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd274-2de5-4859-8872-6de6ab2ca695 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.857919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.859226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.859711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.860195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.868285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:51.870194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:51.882887 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:51.883995 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:51.884948 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:51.887767 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 393/792] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:51.888930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:51.897902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.937743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d97c0-3ced-4483-bc24-641336cf2022 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:51.986781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:51.987403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.987731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.988027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.989083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:51.989388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:51.991017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.005574 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 400/793] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:52.005574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.015360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770023-d105-49a5-a3fa-b13e8fd16e97 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.026069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.059225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.060218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.060218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.062188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.071332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:52.077446 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:52.078402 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:52.079246 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 394/794] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:52.080102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.125054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2a01-ccfa-44dc-a1fc-4ab6bbb056d0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.173267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.173919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.174194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.174460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.175203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:52.175502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.176999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.179771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.195279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb48e-c1fc-4a25-9a0e-af9235b7c4ad None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.198835 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 401/795] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:52.199325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.233963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.234953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.235378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.235836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.249448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.251380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:52.267883 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:52.269112 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:52.270194 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:52.270194 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.270194 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:52.272028 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 395/796] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:52.273129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.303897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33b15-464b-4dc2-bbb3-7ce9e8d3f8bf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.343163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.343769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.344043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.344312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.344995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:52.345295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.346745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.356890 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 402/797] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:52.357779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.419129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.439085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.463877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c910-364f-42e7-8bfa-e117711703ff None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.503235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.504174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.504604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.504874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.505524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:52.505821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.507236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.520190 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 403/798] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:52.521260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.527342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91245ef0-faa0-476e-aa10-5c2b41669dd1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.564522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.565516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.566015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.566486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.579689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.581167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c1ed0319-02e0-40da-8807-1c99bf4eb0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:52.595805 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:52.596892 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:52.597829 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:52.597829 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.597829 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:52.597829 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 396/799] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:52.598068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627525-6704-4a45-8932-a6de29fcd6b9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.599073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627525-6704-4a45-8932-a6de29fcd6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.599073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627525-6704-4a45-8932-a6de29fcd6b9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.599886 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 397/800] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:52.600403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627525-6704-4a45-8932-a6de29fcd6b9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.642984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394659da-14f6-4cd0-8e47-ffe217463b19 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.659850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.679593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.680026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.680266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.680542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.680979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.692007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.693598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:52.709256 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:52.710268 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:52.711181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:52.711181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:52.711181 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:52.711181 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 404/801] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:52.711976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.719028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627525-6704-4a45-8932-a6de29fcd6b9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.754665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.755295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.755569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.755880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.763058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.764547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3c086787-b112-4dce-bc01-276b42aaebe8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:52.775773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:52.776772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:52.777725 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 398/802] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:52.778319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefd16-82cc-444c-acdb-31221d619b7b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.778319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefd16-82cc-444c-acdb-31221d619b7b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.778460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefd16-82cc-444c-acdb-31221d619b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.796627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bbaefd16-82cc-444c-acdb-31221d619b7b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:52.798182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bbaefd16-82cc-444c-acdb-31221d619b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:52.824255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641f3c-1a8e-487d-8231-2d4975a1ac53 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.861072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.861592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.861861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.862122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.862799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:52.863085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.864518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.876763 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 405/803] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:52.877108 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 399/804] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:52.878400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f53f1-5dfd-4c51-86ea-422a1d9510d7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.878682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f53f1-5dfd-4c51-86ea-422a1d9510d7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.878947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f53f1-5dfd-4c51-86ea-422a1d9510d7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.880334 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 400/805] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:52.880867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f53f1-5dfd-4c51-86ea-422a1d9510d7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.888704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.921083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.944421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.988318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f53f1-5dfd-4c51-86ea-422a1d9510d7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.006815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7d40-d0a0-4893-90b1-d0f3da0a3e27 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.021646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.022252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.022522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.022787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.023511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:53.023834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.025339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.048222 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 401/806] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:53.048222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.052852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.053541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.053879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.054216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.055081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:53.055241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.056680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a220e4-c946-481a-b28d-29d4aae77764 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.072776 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 406/807] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:53.072776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.072776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.072776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.088100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:53.090074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:53.156073 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 407/808] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:53.156921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.160908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f537c-9d42-43af-89f1-a1e8b9ff98ff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.176443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.182551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.198440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.199391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.199665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.199976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.207165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.208761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:53.221783 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:53.222732 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.223636 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 402/809] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:53.224178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.262700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ddb32-e514-444c-8db0-e09e2d495fcb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.305098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.305973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.306440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.306910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.337337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c660b-80c7-4efc-bb3c-d87b848b81cd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.373707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.374415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.374756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.375085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.379031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.380595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.382934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.385177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:53.397299 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:53.398424 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.399548 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 403/810] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:53.402071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.404058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.450388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.494320 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 408/811] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:53.495161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.510312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f318-075a-46a2-8bc6-d5db517142ed None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.543395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.544046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.544314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.544577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.545154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.546520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:53.554864 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:53.556114 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:56:53.557143 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.561186 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 404/812] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:53.561870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.597187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec6b86-621f-452d-b51f-e7c4f4c04cc5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.614347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.631440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.632143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.632413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.632676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.633362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:53.633658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.635139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.646548 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 409/813] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:53.647160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.659599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67ef6-2624-4709-b1e5-8166559e5ab2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.661982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.693088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.693693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.693964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.694224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.694949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:53.695245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.696943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.714289 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 405/814] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:53.715126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.750472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e74bea-dcdc-47af-9ab8-e4d999c66f87 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.783604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.784269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.784543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.784814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.785401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.786796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:53.796276 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:53.797435 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:53.798284 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 410/815] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:53.799078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.814269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4621d-fea9-4a76-b15b-07bc84440173 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.842177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.848505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.849122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.849401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.849670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.859713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.861544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:53.876025 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:53.877092 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:53.878000 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:53.878000 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:53.878000 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:53.878000 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 406/816] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:53.878000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.893268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:53.900732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cbe4b-98bd-401f-b5f0-0ccac41ab558 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:53.933200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:53.933806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:53.934076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:53.934338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:53.934959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:53.935254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:53.936659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:53.941002 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 411/817] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:53.941757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:53.982680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9966d-457c-4ecf-b73e-72427d58b8fa None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.013814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.014470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.014734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.014995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/9842b5bcc876492e9e765c86a3ba3138/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.016871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=9842b5bcc876492e9e765c86a3ba3138, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.018285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.033292 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 407/818] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:53 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/9842b5bcc876492e9e765c86a3ba3138/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:54.034104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.046226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e2cd-dbec-435c-aad2-a19c4686b2c8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.058177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.093020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.093683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.093958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.094224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.106750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.108261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.121536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:54.125429 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:54.126440 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:54.127399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:54.127399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:54.127399 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:54.132170 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 412/819] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:54.133145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.156289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a5a6-3ffd-4e0b-973d-73fa72642829 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.194918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.195634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.196026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.196431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.197748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:54.198560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.199909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.204436 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 408/820] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:54.205237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.256554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf63c-b481-4738-9adb-a768dbbd042f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.295783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.296961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.297241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.297513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.298321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:54.298632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.300365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.314018 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 413/821] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:54.315050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.315381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9ec8-d20c-4b53-93d8-48cff5f67c55 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.338336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.350265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.350956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.351326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.351663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.352409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] RBAC: Adding query filter params (type=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:54.352978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.354392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.363767 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 409/822] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:54.363767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.366356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.431383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78145f4-a8b5-44ca-aeb1-fd1a038a3f67 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.466134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.466749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.467025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.467295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.467972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:54.468271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.469049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f625d93-308a-4d43-8635-f87b232b4699 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.469653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.482328 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 414/823] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:54.483372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.511847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.512441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.512713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.512977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.513602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:54.513894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.515320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.520298 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 410/824] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:54.521043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.575629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.593667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.599982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90e9f-1ecd-4d5e-a6f6-d50712290bf7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.631319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcca5d-0cab-444f-aba6-229fff7b306c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.635532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.636203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.636479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.636745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.643577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.645072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:54.657591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:54.658700 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:54.659594 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 415/825] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:54.660118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.675827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.676901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.677036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.677357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.677881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.679236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.703356 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 411/826] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:56:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:54.704206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.794480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3a44c-8c93-41ba-a573-da896daa272d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.850860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b037-3c6f-4367-948e-9ac611c529d1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:54.853364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.854469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.854749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.855036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.857942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.867558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.869639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.875632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:54.886060 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:54.887202 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:54.888395 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:54.889732 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 416/827] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:54.894856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:54.904057 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:54.905255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.905651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.906018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.906798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:54.911675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:54.939320 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 412/828] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:56:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:54.940968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.026830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db60b-409c-4f57-825d-9bb59d8489a5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.074774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.075791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.076115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ae0e-a0da-4bc7-8a5d-9cd74d966ee7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.076482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.076897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.077845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:55.078298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.080126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.094624 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 417/829] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:55.102083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.119692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.120355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.120629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.120903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.121606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:55.121903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.124229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.140554 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 413/830] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:55.146982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.169397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:55.193724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:55.238788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129d344-9aad-441b-83aa-d6969e8880e5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.275848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7048cc-6007-462c-afdf-c9f7e6fc14c5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.297732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.298356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.298648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.298919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.299669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:55.300187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.301649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f783b9-63d4-42da-bb47-e489f09e58b0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.319962 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 418/831] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:55 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:55.331223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.331872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.332150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.332421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/c94db960d5bd475da8b98ca7c4c699b2/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.349961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=c94db960d5bd475da8b98ca7c4c699b2, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.351610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19963bd-2f01-4a93-9eae-ab359dcba0d4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.368887 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 414/832] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:55 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/c94db960d5bd475da8b98ca7c4c699b2/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:56:56.032222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40513d0-2852-4489-8ae8-7f6fbf8725b0 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.032623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40513d0-2852-4489-8ae8-7f6fbf8725b0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.032753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40513d0-2852-4489-8ae8-7f6fbf8725b0 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.034344 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 419/833] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:56.040177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.040663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.041859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.060175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:56.061375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:56.131476 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 415/834] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:56.406787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40513d0-2852-4489-8ae8-7f6fbf8725b0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:56.517103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40513d0-2852-4489-8ae8-7f6fbf8725b0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:56.533039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:56.556461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:56.557199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.557965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.557965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.569416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:56.574569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:56.575525 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:56.576442 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 420/835] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:56.581685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:56.601520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:56.692362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97a979-a583-4b8f-b9cf-197d2f0f15a0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:56.727820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:56.728606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.728952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.729222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.729943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:56.730246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:56.731711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:56.740151 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 416/836] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:56.745822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:56.847600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc191-828a-4e2a-ba33-b8d98ef926bd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:56.881862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:56.882492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.882763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.883024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.893991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:56.895447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b480db59-ec49-4091-ae8e-874bb534f3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:56.910286 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:56.911295 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:56.912260 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:56.912260 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:56.912260 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:56.912260 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 421/837] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:56.918095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:56.939966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be430-92bc-4549-a9a4-d662ff8d3f23 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.940296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be430-92bc-4549-a9a4-d662ff8d3f23 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.940573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be430-92bc-4549-a9a4-d662ff8d3f23 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.942120 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 422/838] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:56.947891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:56.948167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:56.948427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:56.968034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:56.969250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:56.996576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.014341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.039953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6638a-f5fb-4af2-b951-c34129f51634 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.062307 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 423/839] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:57.080808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.082020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.082460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.082886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.083800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:57.084237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.085789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.098509 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 417/840] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:57.104472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.206497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea044b9-3636-43b3-9dd0-5ef7a037d428 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.242011 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.242923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.243547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.244024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.251601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.253250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:57.265688 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:57.266928 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:56:57.268132 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:57.270298 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 424/841] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:57.276773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.326459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.350655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.392791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791f6d-a4b8-4f2f-9a50-2ce605ee3e98 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.431022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.432055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.432527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.432988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.433932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:57.434427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.436081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67c173-ec9b-4500-b717-b36e4892491c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.438949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.451934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b520bc-b231-46b1-8ddc-dfa2ba492fb2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.454913 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 418/842] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:57.456096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9798-421f-4c6a-8176-726a73a97ee7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.456346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9798-421f-4c6a-8176-726a73a97ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.456640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9798-421f-4c6a-8176-726a73a97ee7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.457969 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 419/843] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:57.463295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681431b-3b58-4973-aa25-00e3daf3bb4e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.463561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681431b-3b58-4973-aa25-00e3daf3bb4e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.463832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681431b-3b58-4973-aa25-00e3daf3bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.482702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e681431b-3b58-4973-aa25-00e3daf3bb4e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:57.484459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e681431b-3b58-4973-aa25-00e3daf3bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.493608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.494354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.494620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.494890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.495506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.497010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:57.505901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:57.507118 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:57.508013 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 425/844] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:57.508835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.551542 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 420/845] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:57.552835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d9aff-49fa-4192-be35-0a3c58819dc5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.553118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d9aff-49fa-4192-be35-0a3c58819dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.553387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d9aff-49fa-4192-be35-0a3c58819dc5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.558856 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 421/846] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:57.558856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d9aff-49fa-4192-be35-0a3c58819dc5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.600810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.621804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9959f3-f41d-4b94-8362-a24703cb6085 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.655874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.656480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.656752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.657020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.659111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d9aff-49fa-4192-be35-0a3c58819dc5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.684717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.698022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.699311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.699797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.700242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.701401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:57.701900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.703989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae2e43-b86a-4ca0-989a-80f2e8896820 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.710100 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 422/847] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:57.711857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.712355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.713039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.726434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.728016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.735263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:57.736696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.816206 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 423/848] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:57.817099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.930457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.933562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199e28-2df5-460a-be01-8319de8e8eca None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:57.951877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:57.952900 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 426/849] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:57.953859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:57.973616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:57.974237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.974508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.974777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.975400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:57.975697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:57.977109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:57.982100 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 424/850] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:57.982863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.089739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e8eec-36d2-4c35-aae8-eb3cb4c234cd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.118654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd383-2888-4dd3-b94a-58d59e05d037 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.127411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.128076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.128371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.128611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.129208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.130578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.141695 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.142718 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:58.143625 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 427/851] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.144484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.163672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.164844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.165261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.165709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.177437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.178892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.192543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:58.194772 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.196013 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:58.197302 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:58.197302 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:58.197302 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:58.197302 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 425/852] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.197302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.232476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.257365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72394c-4c30-4d57-a238-8ecee58c0ce4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.299162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f4f-7d28-4c89-9fd1-a91ba8462357 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.302901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.303538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.303836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.304105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.316255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:58.322115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.323102 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 428/853] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.323995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.340787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.341409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.341694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.341963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.342598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.342898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.344360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.348995 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 426/854] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.349761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.438874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2947bc-f9fb-4cf4-8334-e02787262fa3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.441352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.460974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.466924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d1a6-a961-4514-93ef-751fa20582ed None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.477025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.478354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.479102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.479606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.480434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.480881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.482428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.495220 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 429/855] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.496166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.513335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.514197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.514462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.514743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.515417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.515714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.517087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.525589 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 427/856] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.526457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.607721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea397-412a-4416-afa0-1ba9673cf3d1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.629440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9ee5-68f9-4384-9406-68df260f392a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.642951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.643757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.644095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.644430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.645142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.645512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.647181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.661997 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 430/857] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.661997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.680427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.682491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.682845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.683692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.687343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.694510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.698087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:58.715007 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.716172 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:58.717079 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 428/858] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.723930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.755638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.777923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc74cf4-975f-447c-93b7-75463e09fcdf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.826912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.827942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.828218 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.828485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.840449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.842073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.853975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ea9a-3fb2-4174-8f42-e78d84b76da2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:58.859542 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.860532 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:58.861451 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:58.861451 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:58.861451 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:58.865599 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 431/859] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.866460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.903782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.904762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.905478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.905947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.907778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.908337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.909960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.927952 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 429/860] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.934235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.957710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.980496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a18a-b5fa-4f99-8739-321ac6242f6d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.018465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.019553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.020054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.020631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.021501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:59.022014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.023049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:59.025615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.040154 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 432/861] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:59.046311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:59.049186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7790a2-7543-43dd-a623-11db275ea6cb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.103757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83257e70-127e-428a-acc4-36daba352731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.104554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83257e70-127e-428a-acc4-36daba352731 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.104950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83257e70-127e-428a-acc4-36daba352731 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.105561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83257e70-127e-428a-acc4-36daba352731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.106960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83257e70-127e-428a-acc4-36daba352731 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=9842b5bcc876492e9e765c86a3ba3138) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:59.107396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83257e70-127e-428a-acc4-36daba352731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.109484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83257e70-127e-428a-acc4-36daba352731 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.118000 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 430/862] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/role_assignments?user.id=9842b5bcc876492e9e765c86a3ba3138&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:59.174018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b99cf-7109-4b0b-98f7-94eac7dbd514 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.215356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.216056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.216334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.216605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.224763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.226268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.230303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:59.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:59.241691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:56:59.242957 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 433/863] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:59.250184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83257e70-127e-428a-acc4-36daba352731 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:59.365695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83257e70-127e-428a-acc4-36daba352731 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.400600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.401220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.401498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.401771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.402506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:59.402800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.404260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.427527 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 431/864] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:56:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:59.429030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:59.541938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7bb02-e719-4ad3-b453-17c92f73c362 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.579435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.580464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.580941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.581406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.652617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:59.656813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.658668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920c45e-7517-4423-8804-3250a27663f6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.773983 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 434/865] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:59.782542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:59.784812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:59.892515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbba47-d5b3-4c14-bb22-ea9b5dc194b4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:59.917513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6700f-716e-4fa0-8922-319ea8ccee60 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.917818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6700f-716e-4fa0-8922-319ea8ccee60 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.918049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6700f-716e-4fa0-8922-319ea8ccee60 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.919635 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 435/866] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:59.924543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.924820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.925087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.930680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:59.932329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:59.933626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:59.934096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:59.943290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:59.944674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:59.946151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:59.949542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:59.965315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:59.966326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:59.967269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:59.967269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:59.967269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:56:59.967269 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 432/867] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:59.972161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.028953 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 436/868] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:00.038655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.091010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919e83-d1e4-4bc3-9c88-5d57c91e7152 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.126816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.127770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.128226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.128668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.129585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:00.130058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.131604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.144994 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 433/869] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:00.152907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.184195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.260918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5f3e-f065-48a5-ab6e-7160cc6987c6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.309792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.310696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.311117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.311556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.318833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.320481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.327607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:00.334120 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:00.335244 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:00.336409 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:00.339531 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 437/870] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:00.348886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.448560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21608d-e99d-4686-8318-816a5cfc75ba None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.463784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.468182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:00.475584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147e3b-4a55-4da5-b21c-753e1f22a8c0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.496126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.496746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.497024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.497290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.497943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.500031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.514181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.515253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.515761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.516408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.517376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:00.517863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.519878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79858f3-6829-4396-9774-4591ac6ef54f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.524102 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 434/871] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:00 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:57:00.543770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 438/872] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:00.546038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:00.668028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44454-46ae-4abf-893e-0144d4c13952 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.668673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44454-46ae-4abf-893e-0144d4c13952 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.669150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44454-46ae-4abf-893e-0144d4c13952 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.670690 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 439/873] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:00.675099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58225-fbfb-43ff-b8ff-8aff3f0c1917 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:00.676808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6390-a0de-4040-b70b-58701d703a4d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.677083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6390-a0de-4040-b70b-58701d703a4d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.677367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6390-a0de-4040-b70b-58701d703a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.701160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ad3f6390-a0de-4040-b70b-58701d703a4d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:00.702766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ad3f6390-a0de-4040-b70b-58701d703a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:00.709037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:00.709927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:00.710409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:00.710954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:00.711704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=c94db960d5bd475da8b98ca7c4c699b2) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:00.712246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:00.714535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:00.723837 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 435/874] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:00 2022] GET /identity/v3/role_assignments?user.id=c94db960d5bd475da8b98ca7c4c699b2&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:00.795008 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 440/875] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:01.063360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:01.098453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:01.167603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-ca84-41b5-92cc-b09aebcc05be None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:01.202470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:01.203090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:01.203368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:01.203636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:01.204320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:01.205696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cea16-57e9-4b4b-9872-755d3c3d106c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:01.225378 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 436/876] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:01 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:01.234307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a36-dba5-4232-ae02-7f4fc3d088ee None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:01.234615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a36-dba5-4232-ae02-7f4fc3d088ee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:01.234868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a36-dba5-4232-ae02-7f4fc3d088ee None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:01.236491 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 441/877] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:01.242444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:01.243133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:01.244362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:01.265246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:01.266896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:01.362595 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 437/878] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:01.639508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa30a36-dba5-4232-ae02-7f4fc3d088ee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:01.730245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:01.751380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa30a36-dba5-4232-ae02-7f4fc3d088ee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:01.786680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:01.787316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:01.787589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:01.787874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:01.788456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:01.789820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:01.799082 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:01.800176 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:01.801042 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 442/879] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:01.809211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:01.831363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:01.913525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbcd3c-3547-4afa-9eb4-7ee64ace0440 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:01.951363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:01.952013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:01.952289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:01.952556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:01.953186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:01.953483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:01.954859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037b37-f8c2-4037-bb2c-831804eceff6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:01.959847 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 438/880] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:01.965831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:02.067217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6842-0687-4688-bb03-25eb21735ea0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:02.101269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:02.102213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.103445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.103969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.104807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:02.105324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:02.106894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c026edb-684f-4765-b9af-6d6c2bab30d1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:02.111995 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 443/881] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:02.619182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860775-586e-4baa-804a-c93283a9532d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.619844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860775-586e-4baa-804a-c93283a9532d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.619844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860775-586e-4baa-804a-c93283a9532d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.621232 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 439/882] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:02.626450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06f37-7645-4eaa-843b-edfb7a0bc193 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.626729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06f37-7645-4eaa-843b-edfb7a0bc193 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.626993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06f37-7645-4eaa-843b-edfb7a0bc193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.645182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-60f06f37-7645-4eaa-843b-edfb7a0bc193 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:02.646359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-60f06f37-7645-4eaa-843b-edfb7a0bc193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:02.648395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:02.714881 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 444/883] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:02.759462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851664b-7cbe-4794-bd16-d0cc809cc706 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.760137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851664b-7cbe-4794-bd16-d0cc809cc706 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.760137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851664b-7cbe-4794-bd16-d0cc809cc706 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.761600 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 440/884] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:02.766909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:02.767197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:02.767468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:02.791507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:02.792775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:02.868343 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 445/885] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:02.996805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851664b-7cbe-4794-bd16-d0cc809cc706 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.087295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.104836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851664b-7cbe-4794-bd16-d0cc809cc706 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.144189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.144838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.145120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.145383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.145978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.147368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.154020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:03.158286 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:03.159295 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:03.160519 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 441/886] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:03.170629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.248832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.286301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505b7a-8562-4adb-be88-d93445c709a6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.290389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede79a-ae1d-4cf5-9c78-5c6d9bfe9aba None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.324805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.325444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.326003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.326264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.326993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.327781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.328197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.328637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.329405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:03.329843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.331344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a549f-e635-4559-a2ee-0470c0479cd1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.340778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:03.340947 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 442/887] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:03.341515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0630d-1601-423a-992a-b039f4f5de23 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:03.341623 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:03.342516 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:03.343371 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:03.344073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0630d-1601-423a-992a-b039f4f5de23 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.344073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0630d-1601-423a-992a-b039f4f5de23 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.344226 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 446/888] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:03.344226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.352268 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 443/889] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:03.352268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0630d-1601-423a-992a-b039f4f5de23 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.365335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.452855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279deb-eb0e-4083-bcec-9ab87c3ba452 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.457576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0630d-1601-423a-992a-b039f4f5de23 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.481951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.490526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.491132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.491404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.491732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.492333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:03.492628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.492920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.493567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.493846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.494117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.494210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2569-fecd-4148-a8cd-c27de716f5dd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.494787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:03.495088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.496500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.505113 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 447/890] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:03.505113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.505113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.505113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.511898 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 444/891] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:03.511898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.519322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:03.520634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:03.599787 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 448/892] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:03.599787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.607507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.642457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8e92-9b73-4670-a414-b126483fe1ab None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.689736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.690354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.690626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.690888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.691594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] RBAC: Adding query filter params (interface=public, service_id=b8374a46de3b483bb68a345908801b4b, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:03.691919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.693284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.706560 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 445/893] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/endpoints?service_id=b8374a46de3b483bb68a345908801b4b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:03.707673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.725509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92abff0-b0dc-4685-9b30-70c30f42ea2a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.754192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.770296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.771447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.771923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.772550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.786985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.789022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:03.808715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:03.809728 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:03.810637 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:03.810637 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:03.810637 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:03.813168 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 449/894] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:03.822725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.836366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277db2d-d00f-48dc-8a5e-632c1b74194e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:03.874760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:03.875378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:03.875655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:03.875955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:03.876564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:03.877934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:03.888422 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 446/895] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:57:03.888422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:03.888987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:03.955688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414387-064f-4a6f-b7e3-45773dffef69 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.006248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.007954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.008404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.009128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.009980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:04.010456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.010739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824478-6073-4d79-8277-edfb0bc937a9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.012517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.030543 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 450/896] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:04.036229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.060673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.061321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.061597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.061864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.062455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.064332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3e524084-57fc-485f-9af7-f6c88471a4dc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:04.073614 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:04.074617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:04.075540 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 447/897] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Aug 21 00:57:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:04.076445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2080b53-6bd9-49f4-837c-df19a78d3d16 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.076445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2080b53-6bd9-49f4-837c-df19a78d3d16 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.076445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2080b53-6bd9-49f4-837c-df19a78d3d16 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.077841 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 448/898] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:04.080167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.083118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2080b53-6bd9-49f4-837c-df19a78d3d16 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.148179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87b3d7-aea8-4698-bc6a-6beffab13fd3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.153922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.185396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.186032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.186308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.186579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.194391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.194590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2080b53-6bd9-49f4-837c-df19a78d3d16 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.195891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f5bb2a7c-cf8f-4010-91e1-96689fd2c80b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:04.208009 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:04.209030 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:04.209988 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:04.210594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.210594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.211229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.230126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:04.231317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:04.234869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.235464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.235753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.236025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.236652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:04.236958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.238297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.243900 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:04.249197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.306170 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 452/901] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:04.313326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.342389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.361119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612911-2260-49ef-9148-a7a9eded8966 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.392045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.399767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.400400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.400676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.400950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.401793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:04.402101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.403640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.423427 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:04.423884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e135e2-56cc-4710-9dd0-5774711774c4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.435771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.458444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.459057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.459329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.459602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.460311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:04.460608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.462096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.468556 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 453/903] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:04.474165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.558059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ee82-5a2a-4a34-b76e-d388ae66fe16 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.578162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.594164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.594777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.595049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.595310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.596340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0296-c101-4323-83d2-15a7ea5a3fda None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.632935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.633727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.633727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.633727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.635517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] RBAC: Adding query filter params (interface=public, service_id=8f3acd9362ed459480a4c9a2356ecdb1, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:04.636097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.637596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.647647 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 454/904] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/endpoints?service_id=8f3acd9362ed459480a4c9a2356ecdb1&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:04.647647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.656269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.671633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.673338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.747393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb83f7-be2f-4e87-9088-f5505c3a8d35 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.781475 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 451/905] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:57:04.782459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.784833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.785767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.786047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.786344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.786989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.788414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.807783 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 455/906] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:04 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:04.807783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:04.824149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.892516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:04.907271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1313-cfaf-4042-ada5-12736fd22fe9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.937248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcca48-09c9-45b0-8ddd-8baa4518a4a1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:04.946907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.947534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.947855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.948125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.948745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.950258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:04.964210 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 452/907] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:57:04.978359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:04.979332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:04.979804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:04.980226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:04.994465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:04.996456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:05.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:05.014951 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:05.016115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:05.016115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:05.016115 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:05.018127 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 456/908] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:05.023627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:05.133777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159fe4-dc1d-40a6-bdaa-a8494c62005a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:05.168458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:05.169229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.169615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.169975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.170727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:05.171126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:05.172603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:05.184570 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 453/909] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:05.191255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:05.254337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:05.298931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9955b-0834-4e55-96ff-a51a4edf6821 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:05.334003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:05.334738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.335021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.335328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.342661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:05.344171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:05.356125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:05.357084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:05.358006 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 457/910] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:05.364832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:05.381045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:05.472997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da16ca5-3b83-4ae4-bf87-fc6539cd3f93 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:05.507715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:05.508874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.509379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.509857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.510767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:05.511278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:05.512955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67171a47-27e8-4e94-b78f-272eb5404438 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:05.530102 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 454/911] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:05.536453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:05.653149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a54bc1-b6dd-475c-8ff6-95a510a7755c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:05.673240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:05.687437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:05.688076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.688351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.688621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.689348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] RBAC: Adding query filter params (role.id=3e062ab250dd48538897afad11a4425b, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=c94db960d5bd475da8b98ca7c4c699b2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:05.689654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:05.691095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09bd27-75f5-4015-8513-2c98a14d0227 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:05.697088 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 458/912] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:05 2022] GET /identity/v3/role_assignments?user.id=c94db960d5bd475da8b98ca7c4c699b2&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=3e062ab250dd48538897afad11a4425b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:05.853075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4676-1628-40b5-999e-e5b954aae0fe None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.853587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4676-1628-40b5-999e-e5b954aae0fe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.853587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4676-1628-40b5-999e-e5b954aae0fe None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.855141 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 455/913] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:05.860679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:05.861103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:05.861272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:05.879926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:05.881113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:05.950951 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 459/914] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:06.218898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc4676-1628-40b5-999e-e5b954aae0fe None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:06.294533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:06.325623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc4676-1628-40b5-999e-e5b954aae0fe None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:06.360992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:06.361635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.361911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.362180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.362829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:06.364281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:06.373580 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:06.374599 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:57:06.375452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:06.379862 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 456/915] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:06.381303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:06.493321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629dc96-5217-4525-8128-10a1804ee9fc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:06.508480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:06.539381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:06.540287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.540572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.540841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.542182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:06.542182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:06.543606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:06.549271 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 460/916] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:06.555367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:06.660786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ac4ee-6461-4659-9894-ffc4ecfcff84 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:06.695658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:06.696789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.697294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.697775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.698606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:06.699105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:06.700723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a428-01bb-4fda-bb53-0e315661bca3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:06.703173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:06.706476 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 457/917] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Aug 21 00:57:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:06.712960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:06.819387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de67dcd-e834-4be5-b986-d0c30571a4d6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:06.855015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:06.855636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.855935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.856205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.856873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:06.858262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f5863-d4ca-47df-9d6b-e321f3113c16 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:06.863436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a815-73a2-4968-80f8-78605d82819e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.863939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a815-73a2-4968-80f8-78605d82819e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.864016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a815-73a2-4968-80f8-78605d82819e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.865525 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 458/918] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:06.870923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.871402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.871570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.884282 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 461/919] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:06.908999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:06.916476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:06.938552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06aa9-c023-49d2-a8a8-c72c59b534f9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.938818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06aa9-c023-49d2-a8a8-c72c59b534f9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.939087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06aa9-c023-49d2-a8a8-c72c59b534f9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.940856 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 462/920] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:06.946318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:06.946558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:06.946815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:06.970534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:06.971850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:07.006518 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 459/921] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:07.014103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:07.057674 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 463/922] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:07.272154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.351018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.402425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cd69-c403-4dbc-a618-eac4a53d318f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.443140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:07.448918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.449561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.450085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.450361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.451417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.453112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:07.465142 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:07.466396 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:07.467517 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 460/923] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:07.472215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b341e-3b45-4951-93b9-44b52e213e76 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.475069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.514726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.515724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.516248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.516715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.517505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.519139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:07.528385 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:07.529317 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:57:07.530223 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:07.532910 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 464/924] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:07.539116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.582213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:07.598358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa261c-5afe-40c6-a260-0e80611c34e9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.644892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.645899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.646395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.646854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.648313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:07.648832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.651587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.663794 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 461/925] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:07.665488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.682609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e433b0c-492b-4f25-a2d3-b0cbfd7967d3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.726579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:07.728275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.729302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.729915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.730343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.731329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:07.732144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.734237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413169f-5f16-49e3-a3ec-df4250eb0329 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.743852 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 465/926] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:07.743852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a852-8eb9-4d92-8c46-f82652a52b44 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.743852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a852-8eb9-4d92-8c46-f82652a52b44 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.743852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a852-8eb9-4d92-8c46-f82652a52b44 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.743852 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 466/927] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:07.746965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a852-8eb9-4d92-8c46-f82652a52b44 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.781634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac3aea-c463-4090-81fa-89fafff442c5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.817083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.817698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.818439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.818707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.819338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:07.819635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.821106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bb25b-9114-4d6c-b383-dc4d4834be50 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.826686 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 462/928] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:07.832501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.832782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.833049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.847541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:07.851859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:07.853646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:07.859378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a852-8eb9-4d92-8c46-f82652a52b44 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:07.895227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:07.895922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:07.896193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:07.896474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:07.897109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:07.897406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:07.898798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:07.908858 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 467/929] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:07.908858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.925853 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 463/930] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:07.926559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:07.989225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.038758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eec59-c1a7-4955-957a-44b17271f8e8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.060271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89265-e5b9-498b-b001-7810aedc56c0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.080814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.081430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.082213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.082490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.083462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] RBAC: Adding query filter params (interface=public, service_id=582da342fc7d4914bcff2770bebc0dd8, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:08.083790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.085815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.094244 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 468/931] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:57:07 2022] GET /identity/v3/endpoints?service_id=582da342fc7d4914bcff2770bebc0dd8&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:08.099388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.101814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.104076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.104353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.104617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.105288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.106647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.130233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.132500 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 464/932] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:08.223341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.226793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e39f6-7ef8-4dea-b4b5-e39ceb58a925 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.289097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.289097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.289097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.289435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.290269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.292082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.301964 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 469/933] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:57:08.370304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb7d0-c2b3-4601-b6bb-0e742b754927 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.373451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.411884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.413017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.413499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.414208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.428199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:08.433881 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:08.434975 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:08.435928 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 465/934] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:08.444923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.546519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.569542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7acc5-e9b7-4872-a742-432fb6f5fe4a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.607025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.608072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.608536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.608984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.609850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:08.610342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.612009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.621390 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 470/935] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:08.627281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.741346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b357e-6b69-42ce-9a5c-03820261674d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.775530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.776522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.776987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.777433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.787855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.789676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-33b5a313-bb4c-469b-b903-c7e80a51877a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:08.805240 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:08.806442 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:08.807348 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:08.807348 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:08.807348 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:08.809134 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 466/936] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:08.815016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.880004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39e9-200c-44b7-942c-449f6710abae None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.880363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39e9-200c-44b7-942c-449f6710abae None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.880558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39e9-200c-44b7-942c-449f6710abae None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.882148 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 467/937] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:08.887120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.887398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.887670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.906671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:08.907981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:08.921325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.927593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b913-4fcf-4db9-8cb1-70e3499ad8b6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:08.965125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:08.965799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:08.966075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:08.966347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:08.966987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:08.967284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:08.968821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:08.989647 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 471/938] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:08.991621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:08.995424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.008068 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 468/939] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:09.098553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c7c0-5a04-4ecc-99e1-08db9b4d0dc7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.134277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.135269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.135810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.136283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.143734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.145490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:09.157500 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:09.158513 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:09.159495 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.162032 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 472/940] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:57:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:09.172854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.276145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6890e-ed6c-4748-b583-b8019d047f20 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.291809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.336254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.337027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.337429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.337818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.338676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:09.338974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.341197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.365381 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 469/941] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:09.370888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.374554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.378562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.423055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad4f78-12b3-4c41-bc64-aaf1b41b8cf5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.461918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.462671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.462950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.463217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.463902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.465559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.468412 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING keystone.server.flask.common [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 00:57:09.474481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6430aa7-edc9-410f-9f6b-72f2ff867d7f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.488856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.sql.core [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:57:09.488856 dv-cinder-master-3-smb devstack@keystone.service[81510]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:57:09.488856 dv-cinder-master-3-smb devstack@keystone.service[81510]: [parameters: {'id': '893ccb7e181745299b6fef89843ad613', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:57:09.488856 dv-cinder-master-3-smb devstack@keystone.service[81510]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81510) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 893ccb7e181745299b6fef89843ad613.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 893ccb7e181745299b6fef89843ad613. Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:57:09.496812 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 21 00:57:09.498559 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application yield resource Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise self.value Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application session.commit() Aug 21 00:57:09.500820 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:57:09.502857 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:57:09.513101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:57:09.514926 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [parameters: {'id': '893ccb7e181745299b6fef89843ad613', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.517024 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:09.518871 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 893ccb7e181745299b6fef89843ad613. Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 473/942] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Aug 21 00:57:09 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:09.529237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.530648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.530648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.530648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.530648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.531185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.531185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:09.537140 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:09.539284 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:09.541831 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:09.541831 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:09.541831 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:09.547775 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 470/943] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:09.547775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.602530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.615655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116280-68d6-4fbe-bf65-43eebd550367 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.635545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.655152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfede00-459f-4e5e-9e7b-5013dabe17f7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.655905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.656872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.657305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.657854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.665620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.668067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:09.680743 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:09.681828 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:09.682744 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:09.690526 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 474/944] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:09.691548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.691956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.692327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.692659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.693063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.694107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:09.694461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.696114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.709509 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 471/945] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:09.716998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.798224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2140-1b22-49e2-870e-83d704f09de6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.827411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178989b-85e3-4ce0-8985-f03c2eac8114 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:09.834103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.834981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.835443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.835963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.836908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:09.837404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.839040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.847021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:09.866265 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 475/946] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:09.869200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:09.870166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:09.870587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:09.871017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:09.880079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:09.881853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:09.895237 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:09.896481 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:09.897617 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:09.900189 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 472/947] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:09.906222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:09.953915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:10.020844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41649432-8072-49f3-a3f0-284bc8ee8bc0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:10.064915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:10.065874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.066363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.066822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.067693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:10.068160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:10.069751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec869-fd9a-4382-b919-60bb2a2e4319 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:10.082998 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 476/948] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:10.089418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:10.178342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bb29-43bc-425c-8a12-c83b3e407c49 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.178690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bb29-43bc-425c-8a12-c83b3e407c49 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.178879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bb29-43bc-425c-8a12-c83b3e407c49 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.180693 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 477/949] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:10.186226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9065c4-97d8-4436-9aee-a88cdb9d5946 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.186506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9065c4-97d8-4436-9aee-a88cdb9d5946 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.186776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9065c4-97d8-4436-9aee-a88cdb9d5946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.201728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e0d8d-f2e2-4c87-9b58-7160ab848b06 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:10.208821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2c9065c4-97d8-4436-9aee-a88cdb9d5946 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:10.210723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2c9065c4-97d8-4436-9aee-a88cdb9d5946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:10.236835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:10.238038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.238489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.239048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/c94db960d5bd475da8b98ca7c4c699b2/roles/3e062ab250dd48538897afad11a4425b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.242339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=c94db960d5bd475da8b98ca7c4c699b2, role_id=3e062ab250dd48538897afad11a4425b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:10.245102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9814f-c5a2-47f7-a2db-7b8bb44496eb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:10.262825 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 473/950] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:57:10 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/c94db960d5bd475da8b98ca7c4c699b2/roles/3e062ab250dd48538897afad11a4425b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:57:10.301512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26169f09-3f9c-4b73-bcbc-764fdf70967b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.301750 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 478/951] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:10.301837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26169f09-3f9c-4b73-bcbc-764fdf70967b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.301837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26169f09-3f9c-4b73-bcbc-764fdf70967b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.301837 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 474/952] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:10.306300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.306592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.306857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.326219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:10.327453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:10.355758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:10.411183 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 479/953] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:10.579406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26169f09-3f9c-4b73-bcbc-764fdf70967b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:10.616729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:10.688264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26169f09-3f9c-4b73-bcbc-764fdf70967b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:10.699156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:10.722622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:10.723357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.723639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.723942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.724537 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:10.726091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:10.736161 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:10.737224 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:10.738275 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 475/954] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:10.745607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:10.817243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75589f86-8564-4e8e-a8a9-3191b13b8e0b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:10.862147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:10.862705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.862983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.863252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.863874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:10.865344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:10.866610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:10.871276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f738f3-b9b0-42fc-be4a-50d0b875d845 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:10.876405 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:10.877477 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:10.878561 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:10.882611 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 480/955] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:10.884221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:10.910844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:10.915698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:10.917313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:10.917788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:10.918480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:10.919479 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:10.920006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:10.922062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:10.933340 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 476/956] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:10.935547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:11.008318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644776-3926-4de0-90ea-3ad7cb37bf65 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:11.046605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bd3f-203c-414c-abcd-464d025f4b7a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:11.051981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:11.052701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.053130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.053489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.054281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:11.054698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:11.056577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:11.067033 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 481/957] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:11.068436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:11.087332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:11.088346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.088975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.089391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.090687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:11.091614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:11.093210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:11.107784 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 477/958] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:11.174141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:11.192265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8da7-54dd-4f8e-aea1-aa2a7184f585 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:11.229341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:11.229965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.230241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.230514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.231158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:11.231459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:11.233046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540900b3-d6d6-446d-b317-61a29f4fa9ad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:11.243765 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 482/959] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:11.245311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:11.280486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:11.359051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3f37c-2fd5-4978-a8a3-c9019f2dd518 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:11.396720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:11.397356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.397627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.397897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.398584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:11.400422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe843-4817-4652-8f68-fee720f98c89 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:11.424593 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 478/960] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:11.932471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551efd80-c328-481f-a414-b83ca2a72f0d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.932895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551efd80-c328-481f-a414-b83ca2a72f0d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.933000 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551efd80-c328-481f-a414-b83ca2a72f0d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.934602 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 483/961] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:11.940047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca17d7e-05e1-4185-a39b-19f5eec5067b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:11.940330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca17d7e-05e1-4185-a39b-19f5eec5067b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:11.940598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca17d7e-05e1-4185-a39b-19f5eec5067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:11.960684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2ca17d7e-05e1-4185-a39b-19f5eec5067b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:11.961970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2ca17d7e-05e1-4185-a39b-19f5eec5067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:12.037329 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 479/962] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:12.230147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e837-4751-4c0d-ac63-c977b1befad1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.230672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e837-4751-4c0d-ac63-c977b1befad1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.230885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e837-4751-4c0d-ac63-c977b1befad1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.232719 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 484/963] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:12.238845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.239374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.239619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.259129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:12.260325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:12.263225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:12.302725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e837-4751-4c0d-ac63-c977b1befad1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.332603 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 480/964] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:12.406393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e837-4751-4c0d-ac63-c977b1befad1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.440822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.441813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.442286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.442770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.443607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:12.445282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:12.461347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.sql.core [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:57:12.461347 dv-cinder-master-3-smb devstack@keystone.service[81510]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:57:12.461347 dv-cinder-master-3-smb devstack@keystone.service[81510]: [parameters: {'user_id': '059d6902c1b74bda9f547cf5a4835a6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:57:12.461347 dv-cinder-master-3-smb devstack@keystone.service[81510]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81510) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:57:12.469522 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:57:12.470443 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application yield resource Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise self.value Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application session.commit() Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:57:12.471426 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:57:12.472388 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:57:12.473995 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:57:12.476070 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [parameters: {'user_id': '059d6902c1b74bda9f547cf5a4835a6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:12.478422 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 21 00:57:12.480396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:57:12.483394 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.485135 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 485/965] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Aug 21 00:57:12 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:12.491466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.593280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7a09-e81c-4b36-b460-88abaa3833a1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.605308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.622091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:12.628386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.629024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.629319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.629584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.637716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:12.639164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:12.641736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:12.652164 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:12.653139 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:12.654104 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 481/966] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:12.662613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.733834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0e33-51a0-460e-9bc3-0960c33fb559 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.768212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.768848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.769121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.769386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.773029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d23e-82a4-4c3c-87ff-ece2c39e1e11 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.780713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:12.785392 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:12.786364 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:12.787271 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 486/967] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:12.795125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:12.808391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.809066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.809338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.809654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.810413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:12.810701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:12.812208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:12.855772 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 482/968] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:12.875425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:12.909209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d96fe-580e-4639-be09-15a1c7323277 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:12.947948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:12.949998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:12.950286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:12.950552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:12.951249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:12.951543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:12.953189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e69cf-8f39-42a3-a4c5-2f6db6ad5140 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:12.966370 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 487/969] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:12.972986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.036899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.084597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7262b9-a87b-48d8-a78c-61ee353cafa9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.121835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.122481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.122757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.123026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.134489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.135990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:13.151566 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:13.152622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:13.153513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:13.153513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:13.153513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:13.153513 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 483/970] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:13.155989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192c50-5ca6-41f5-80fd-b60ba12aa882 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.156333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192c50-5ca6-41f5-80fd-b60ba12aa882 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.156670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192c50-5ca6-41f5-80fd-b60ba12aa882 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.162543 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 488/971] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:13.162688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.164790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.164790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.164790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.183228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:13.184836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:13.259789 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 489/972] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:13.268903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9819013-1668-49c1-8e32-6fc76a1640f0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.279699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.309516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.310124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.310394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.310655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.311290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:13.311580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.312968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dab9-f027-4b5b-a8e1-ac55d53eee8b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.330305 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 484/973] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:13.331546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.388829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53b71-e8f1-402a-bacb-e0bc002268a2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.389338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53b71-e8f1-402a-bacb-e0bc002268a2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.389615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53b71-e8f1-402a-bacb-e0bc002268a2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.391077 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 485/974] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:13.394061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.395960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.396298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.396609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.415278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:13.416881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:13.435764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614910f-144a-47bd-8431-bf85a503a692 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.472538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.473162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.473498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.473758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.481673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.483162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.492083 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 486/975] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:13.495698 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:13.496709 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:13.497680 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 490/976] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:13.502447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.533532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.607380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.610365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da8a1-9790-4ae4-b6c2-2d07b6e990a3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.638885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad72515-b42b-4c79-ae01-84599f8b2edd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.645096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.645716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.645992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.646510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.646984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:13.647301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.648787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.663966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.673910 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 487/977] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:13.674800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.675860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.676472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.676746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.677016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.677669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.679082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.697746 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 491/978] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:13 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:57:13.758279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.787643 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eae1c7-e656-4db8-b6f6-f6d327e83222 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.830483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.831170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.831449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.831712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.860359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:13.877737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c827a-8e5e-4fdf-bb76-b34649060741 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:13.912999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:13.913783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:13.914004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:13.914269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:13.914963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.915626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:13.916890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.917457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:13.926083 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:13.927129 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:13.928605 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 492/979] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:13.933553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:13.987648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.017519 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 488/980] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:14.023183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.050481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19688681-71e7-43a3-9913-54d3aa3b47bc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.080712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.085384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.086016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.086279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.086620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.087345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.087732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.089081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.098584 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 493/981] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:14.099687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.125749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d5594-375c-4b14-a38c-7695741e6dec None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.159462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.160151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.160416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.160677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.171719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.173231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:14.188279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:14.189380 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:14.190306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:14.190306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:14.190306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:14.190306 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 489/982] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:14.195076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.214746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff576b-bef1-4203-8126-3eff06679991 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.228417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.254872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.255795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.256238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.256709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.257513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.258001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.259655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.265124 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 494/983] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:14.271115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.314633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13635eb-4019-4a79-a85d-a2dee1264fb8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.321782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.350866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898389a-2614-47b8-adff-531264954a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.351473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898389a-2614-47b8-adff-531264954a2a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.351766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898389a-2614-47b8-adff-531264954a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.352063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898389a-2614-47b8-adff-531264954a2a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.352883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898389a-2614-47b8-adff-531264954a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.353181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898389a-2614-47b8-adff-531264954a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.354540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898389a-2614-47b8-adff-531264954a2a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.366696 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 490/984] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:14.372192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898389a-2614-47b8-adff-531264954a2a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.384492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff61c5-7c81-4b4d-a7bf-6519603719ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.424615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.425231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.425511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.425788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.426511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] RBAC: Adding query filter params (interface=admin, service_id=582da342fc7d4914bcff2770bebc0dd8, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.426819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.428250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.433726 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 495/985] 10.222.0.23 () {56 vars in 1249 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/endpoints?service_id=582da342fc7d4914bcff2770bebc0dd8&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:14.439495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.484953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.485819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898389a-2614-47b8-adff-531264954a2a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.520548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.521284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.521618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.521957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.529824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.531770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.548923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8149a8-bfe2-480c-b3d5-6a83c7e9b8ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:14.549650 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:14.550521 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:14.556531 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 491/986] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:14.557211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.585827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.592994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.593610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.593882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.594147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.594755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.596174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.602484 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 496/987] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:57:14.670646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c49e95-6351-48f1-9562-dc398243c68a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.711113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.712198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.712625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.713060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.713924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.714378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.716023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7dcd9-ec8a-4eac-b341-f3cf2efd1faf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.730897 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 492/988] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:14.737226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:14.846068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab3a5-93bc-4ec7-acbc-e75301255869 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:14.848827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:14.883863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:14.884740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:14.885019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:14.885291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:14.886021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] RBAC: Adding query filter params (role.id=3e062ab250dd48538897afad11a4425b, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=c94db960d5bd475da8b98ca7c4c699b2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:14.886328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:14.887851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576d16-cfac-4cf0-98be-c3fffc2d348c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:14.899822 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 497/989] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:14 2022] GET /identity/v3/role_assignments?user.id=c94db960d5bd475da8b98ca7c4c699b2&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=3e062ab250dd48538897afad11a4425b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:15.646578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8542cd-fcd2-4b51-a677-b326b5dab127 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:15.647124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8542cd-fcd2-4b51-a677-b326b5dab127 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:15.647124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8542cd-fcd2-4b51-a677-b326b5dab127 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:15.648642 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 493/990] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:15.653968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:15.654387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:15.654506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:15.673191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:15.674393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:15.744312 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 498/991] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:16.031773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8542cd-fcd2-4b51-a677-b326b5dab127 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.123951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:16.143538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8542cd-fcd2-4b51-a677-b326b5dab127 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:16.179401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:16.180048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.180445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.180714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.181293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:16.182650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:16.191433 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:16.192533 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:16.196996 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 494/992] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:16.199367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.311121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:16.315439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec40fa0-2562-41a0-ab68-cd29f7d2dd5d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:16.351420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:16.352095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.352367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.352632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.353271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:16.353564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:16.354962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92862efb-9c1d-4977-b0f5-9d30cb801faf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:16.360209 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 499/993] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:16.365795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.473593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4fc00-d98f-4220-8acb-4539e20f753b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:16.507433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:16.508124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.508516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.508786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.509517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:16.509813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:16.511189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:16.513779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b97a-aeb3-4efc-879a-ebe35e074a74 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.514061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b97a-aeb3-4efc-879a-ebe35e074a74 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.514320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b97a-aeb3-4efc-879a-ebe35e074a74 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.515831 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 500/994] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:16.521354 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 495/995] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:16.521487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.521487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.521487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.522219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.538946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:16.540119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:16.541481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:16.612313 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 501/996] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:16.633071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b907a-1728-47e2-bbef-134d10c692ea None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:16.666642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:16.667285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.667568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.668059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.668750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] RBAC: Adding query filter params (interface=public, service_id=820f63fab2e146b5bfbc5b76924189a8, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:16.669047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:16.670400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503036d-8881-4d76-8264-13257a50d8cd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:16.676054 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 496/997] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/endpoints?service_id=820f63fab2e146b5bfbc5b76924189a8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:16.681656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.773708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:16.784271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb4db7-7cda-4828-8bc7-d817a6156707 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:16.818053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:16.818579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.818849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.819111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.819717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:16.821167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52ff45-39db-42ec-80bf-916afe69ced3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:16.827560 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 502/998] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:57:16.842791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a10b0-f20e-47f6-b666-99476afdf1d7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.843144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a10b0-f20e-47f6-b666-99476afdf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.843306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a10b0-f20e-47f6-b666-99476afdf1d7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.845170 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 497/999] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:16.851125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:16.851491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:16.851675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:16.871452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:16.872711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:16.874959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a10b0-f20e-47f6-b666-99476afdf1d7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:16.954265 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 503/1000] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:16.976263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.002032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a10b0-f20e-47f6-b666-99476afdf1d7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.037187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.037817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.038092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.038357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.038931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.040467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:17.049524 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:17.050553 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:17.051464 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 498/1001] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Aug 21 00:57:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:17.056781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.150679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.169667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5735850-da3c-4c27-a256-8bd9b68fc12b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.205382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919697-340c-43e7-b070-e58d474c97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.205997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919697-340c-43e7-b070-e58d474c97de None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.206267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919697-340c-43e7-b070-e58d474c97de None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.206530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919697-340c-43e7-b070-e58d474c97de None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.207162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919697-340c-43e7-b070-e58d474c97de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:17.207460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919697-340c-43e7-b070-e58d474c97de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.208869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919697-340c-43e7-b070-e58d474c97de None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.213958 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 504/1002] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:17.219586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.223103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919697-340c-43e7-b070-e58d474c97de None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.339992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e715631-2f38-4e1d-b391-8c01ff78fe6f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.340736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919697-340c-43e7-b070-e58d474c97de None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.377160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.377775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.378052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.378321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.378573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.378955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:17.379256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.379809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.380263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.380658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.380888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.381774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.385243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.386257 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 499/1003] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Aug 21 00:57:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:17.391840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:17.395837 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:17.399952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:17.401187 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 505/1004] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Aug 21 00:57:17 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:17.403314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.407073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.421725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.504570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbd4f-9e4f-46e8-a166-1b1bc7353667 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.512835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0eed-0f81-4ac5-be55-67fadeb954f3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.539550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.540186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.540466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.540730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.541779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.543102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c6b33-db57-4fe3-b016-6e1042c1a86a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.547238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.547909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.548183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.548447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.549064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:17.549413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.550784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.557659 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 506/1005] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:17.563374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:17.563787 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 500/1006] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:57:17.657723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:17.683334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b546-5d8c-4a5d-b981-e3426524ccc2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:17.731729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:17.733613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:17.733613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:17.733927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:17.735032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] RBAC: Adding query filter params (type=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:17.737367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:17.738025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278e45-4f28-4774-a34d-13aadd869574 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:17.743887 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 507/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:18.773624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06ab2-448d-46a5-8fe8-843467018308 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:18.774277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06ab2-448d-46a5-8fe8-843467018308 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:18.774277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06ab2-448d-46a5-8fe8-843467018308 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:18.775797 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 501/1008] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:18.781500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:18.781926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:18.782025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:18.803210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:18.804498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:18.878490 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 508/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:19.141439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06ab2-448d-46a5-8fe8-843467018308 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:19.210740 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:19.249258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06ab2-448d-46a5-8fe8-843467018308 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:19.282565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:19.283906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.283906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.284190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.286566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:19.286566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:19.303503 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:19.304773 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:57:19.305917 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:19.307326 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 502/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:19.310678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:19.381691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:19.418557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73f96-8231-455f-be57-aabae69155f4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:19.453941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57394782-6335-4946-a658-767e482e4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:19.454556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57394782-6335-4946-a658-767e482e4165 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.454826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57394782-6335-4946-a658-767e482e4165 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.455093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57394782-6335-4946-a658-767e482e4165 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.455724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57394782-6335-4946-a658-767e482e4165 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:19.456098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57394782-6335-4946-a658-767e482e4165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:19.457474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57394782-6335-4946-a658-767e482e4165 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:19.467129 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 509/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:19.468454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:19.484282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd0a78-b09d-4962-8e58-568b490ba15c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.484582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd0a78-b09d-4962-8e58-568b490ba15c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.484880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd0a78-b09d-4962-8e58-568b490ba15c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.486357 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 510/1012] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:19.491488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.491792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.492065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.510726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:19.511942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:19.576545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef33c-f15e-42b2-8749-ff2c56518e7f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:19.582681 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:19.606298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:19.612911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:19.613940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.614242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.614516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.615152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:19.615453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:19.616868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c11ae7-4037-40f5-8507-8c54e58e8372 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:19.622167 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 503/1014] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Aug 21 00:57:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:19.627714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:19.640613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d46b-936c-4e9a-8ef4-e4c239b24e65 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.640896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d46b-936c-4e9a-8ef4-e4c239b24e65 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.641173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d46b-936c-4e9a-8ef4-e4c239b24e65 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.642501 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 504/1015] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:19.647420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.647774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.648003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.665696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:19.667256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:19.694712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:19.735622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa270-6c8d-44da-864d-3431ba559401 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:19.739096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 505/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:19.772681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:19.773293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:19.773564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:19.773900 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:19.774562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:19.776055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:19.803770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 512/1017] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:19.850010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:19.960063 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519a26e-24cf-47b7-bfbf-04c4fae27052 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:19.984117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:20.001946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:20.002584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:20.002861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:20.003135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:20.004275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:20.005710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:20.007582 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 506/1018] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:20.008674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:20.013622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:20.122575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93fc7-eb87-468c-a50f-c051a6f50314 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:20.125358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474e23-119b-436c-9b02-d6df338651ce None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:20.141962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:20.159149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:20.159759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:20.160036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:20.160303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:20.160952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:20.162337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83156-c7ec-4eae-81be-fd426d6cfacf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:20.163597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:20.164478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:20.164898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:20.165324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:20.166608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:20.168544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e145-2c80-41a8-9389-15f28cc1a208 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:20.179683 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 513/1019] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:20 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:20.202629 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 507/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:20 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:57:21.816590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909eacc-b212-4f5d-8549-b5a3b0b7e355 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:21.817155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909eacc-b212-4f5d-8549-b5a3b0b7e355 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:21.817155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909eacc-b212-4f5d-8549-b5a3b0b7e355 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:21.819783 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 514/1021] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:21.824219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6dca-7a3d-4f4b-b5ca-b90dada7f309 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:21.824649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6dca-7a3d-4f4b-b5ca-b90dada7f309 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:21.825084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6dca-7a3d-4f4b-b5ca-b90dada7f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:21.845097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ee5d6dca-7a3d-4f4b-b5ca-b90dada7f309 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:21.846370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ee5d6dca-7a3d-4f4b-b5ca-b90dada7f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:21.885981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:21.936797 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 508/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:22.191013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c612-565b-4824-a133-285bfce47baf None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.191373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c612-565b-4824-a133-285bfce47baf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.191567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c612-565b-4824-a133-285bfce47baf None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.192982 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 515/1023] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:22.198753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419921d-3765-4aec-b9cc-8693933a6458 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.198998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c612-565b-4824-a133-285bfce47baf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.199104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419921d-3765-4aec-b9cc-8693933a6458 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.199289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419921d-3765-4aec-b9cc-8693933a6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.218803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2419921d-3765-4aec-b9cc-8693933a6458 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:22.220060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2419921d-3765-4aec-b9cc-8693933a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:22.304410 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 509/1024] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:22.306076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05c0b-c795-45d8-a84b-d3520c69c528 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.306357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05c0b-c795-45d8-a84b-d3520c69c528 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.306622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05c0b-c795-45d8-a84b-d3520c69c528 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.308215 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 510/1025] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:22.313176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.313534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.313813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.322399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c612-565b-4824-a133-285bfce47baf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.331692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:22.332907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:22.360824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.361454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.361730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.362001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.373915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:22.378892 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:22.379882 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:22.380800 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 516/1026] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:57:22.386683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.408036 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 511/1027] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:22.429422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:22.489548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb9e3e-4cf2-4145-a859-04949e8a92ba None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.523403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.524102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.524364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.524628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.525297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:22.525594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:22.526966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:22.534984 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 517/1028] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:22.540718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.569533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:22.573109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.645373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c184-baf1-40a9-b057-162f43c7816b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.677313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:22.680421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.680860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b382ff-1421-44c5-bf69-4c9e598cddc8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.681080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.681335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.681597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.691624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:22.693098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:22.707034 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:22.708223 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:22.709192 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:22.709192 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:22.709192 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:22.709192 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 512/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:22.709192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.718616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.719255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.719533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.719835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.720945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:22.722810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:22.727770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 518/1030] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:22.727770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.788325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:22.811187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4765ba-b71a-478b-928b-35a1737f8741 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.829773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d824c-d5ce-4577-9c9f-06962d6ab0f0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.844847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.845622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.845905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.846261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] PATH_INFO: `/v3/services/image` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.846952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:22.848361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:22.857171 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:22.858330 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:22.859199 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 513/1031] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:22.860050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.865578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:22.866183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:22.866457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:22.866722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:22.867362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:22.867926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:22.869304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:22.881657 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 519/1032] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:22.882464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:22.909397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:22.965485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4f87-e589-430c-a528-a3d3532cf848 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:22.990165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda82ee-87d3-4c74-aff4-3ac2739d0f99 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.000526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.001239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.001415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.001684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.002562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.003792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.022226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.029865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.030618 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 514/1033] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:57:22 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:23.031654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.042629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.042629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.042629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.042629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] RBAC: Adding query filter params (name=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:23.042629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.044708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.054166 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 520/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:23.060753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.159977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.164312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904f02c-a164-436b-928b-6bc83b46d6c0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.171620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbaa0c-6c3e-4aa5-a594-e5bf29cc0796 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.209573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.210632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.210632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.210918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.219366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.220865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.221518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.222399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.222747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.223087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.224182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] RBAC: Adding query filter params (type=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:23.224182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.225726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.232905 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 521/1035] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:23.237460 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:23.238432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:23.239410 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 515/1036] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:23.241592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.245690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.332664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.377631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfde369-1018-4e30-843e-c5335613d27f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.397948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1aa5-ccbc-46c5-ae4b-c5098a739403 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.411811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.412424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.412702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.412971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.413701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:23.414003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.415468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.433525 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 516/1037] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:23.439581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.439777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.440361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.440634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.440903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.441605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] RBAC: Adding query filter params (interface=public, service_id=942dd0df3bd54c49b2e36b210efc7432, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:23.441904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.444317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.450160 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 522/1038] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/endpoints?service_id=942dd0df3bd54c49b2e36b210efc7432&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:23.455547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.478116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.551723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c24f-1df6-4ae8-b467-3c3c1a904ff1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.560645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ccdf-e0f4-42b2-8115-7edbc98b0b91 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.575722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.596183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.596720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.596840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.596994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.597261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.597582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.597919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.598254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.598945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.600430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.607413 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 523/1039] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:57:23.674820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.676386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.786707 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 517/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:23.793382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.884747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:23.902708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aafe5-bb33-4bf3-af3a-1a0fd77506ad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:23.936858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:23.937490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:23.937765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:23.938033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:23.948373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:23.949837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:23.965614 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:23.966626 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:23.967592 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:23.967592 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:23.967592 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:23.971715 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 524/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:23.972776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:23.990810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:24.076697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464773e-2744-483e-94e3-77c2f6e4544d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:24.111546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:24.112197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.112473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.112743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.113381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:24.113682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:24.115043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:24.127442 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 518/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:24.133038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:24.239503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ae38-bf0a-42a2-9c81-72005734b1b8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:24.273294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:24.273996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.274265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.274540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.277276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:24.283175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:24.287191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:24.305021 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:24.306152 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:24.307313 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:24.309400 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 525/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:24.315108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:24.394123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:24.417967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbfff-f52f-4557-b17d-a9e63956894d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:24.452704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:24.453317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.453594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.453863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.454557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:24.454853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:24.456333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc834-1183-4c1e-b5c1-c7a93b67f951 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:24.473432 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 519/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:24.474651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:24.578285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3e20-261b-4773-bef9-1f4b9b768544 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:24.612401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:24.613015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:24.613287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:24.613552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:24.614280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] RBAC: Adding query filter params (role.id=3e062ab250dd48538897afad11a4425b, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:24.614582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:24.616132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e68d2c-8983-4afb-a1cd-7dc0dc0893c6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:24.627795 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 526/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:24 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=3e062ab250dd48538897afad11a4425b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:25.038790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefec67-ba88-41a2-b2b1-98b8896ce979 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.039431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefec67-ba88-41a2-b2b1-98b8896ce979 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.039431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefec67-ba88-41a2-b2b1-98b8896ce979 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.041538 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 520/1046] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:25.047018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcbbd2-6dbe-455f-88d5-954550e4c9f7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.047494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcbbd2-6dbe-455f-88d5-954550e4c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.047574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcbbd2-6dbe-455f-88d5-954550e4c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.067785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c1fcbbd2-6dbe-455f-88d5-954550e4c9f7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:25.068999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c1fcbbd2-6dbe-455f-88d5-954550e4c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:25.128414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.141104 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 527/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:25.409383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefec67-ba88-41a2-b2b1-98b8896ce979 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:25.493960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca1e9-c527-403d-9156-660b32d55d51 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.494308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca1e9-c527-403d-9156-660b32d55d51 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.494477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca1e9-c527-403d-9156-660b32d55d51 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.496112 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 528/1048] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:25.500879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.501148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.501439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.514207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefec67-ba88-41a2-b2b1-98b8896ce979 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:25.520386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:25.521546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:25.554450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:25.555145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.555467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.555669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.559043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.568137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:25.573364 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:25.574326 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:25.575199 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 521/1049] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:25.580459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:25.599649 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 529/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:25.682692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e1c4-8a2d-420b-9e73-17b24ee018ae None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:25.719137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:25.719768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.720054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.720321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.720986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:25.721283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:25.722648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:25.730949 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 522/1051] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:25.736804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:25.837050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5064-e163-4fd3-a0a6-d5ef72daa502 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:25.859075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.860428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:25.875368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:25.876111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:25.876378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:25.876661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] PATH_INFO: `/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:25.889855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] RBAC: Authorizing `identity:get_user(user_id=7652e9265b1c474eb2aa98c4c4aa3efc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:25.891382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:25.897793 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 530/1052] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:25 2022] GET /identity/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:25.899595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:25.933238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:25.978975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38584-7bb5-4130-ae6b-07089bad9c18 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.011246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff1b2-825f-40c0-86de-53a17a35086e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.016877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.017520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.017794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.018058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] PATH_INFO: `/v3/services/image` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.018644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.020040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:26.029279 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:26.030306 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:26.031155 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 523/1053] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Aug 21 00:57:25 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:26.036270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.051383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.052066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.052362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.052623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.104257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:26.130488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.132277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.143279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9191d2-889e-4e87-bb9d-fe614a95f365 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.170151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:26.183780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.184458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.184686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.184956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.185585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] RBAC: Adding query filter params (name=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:26.185883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.187565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.192481 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 524/1054] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:26.199648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.242173 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 531/1055] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:57:26.243928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.321821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21706f-b935-4dce-a1f4-15cb8d052387 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.330735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:26.356663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d9dc-cad6-4582-8b6f-3f18d8266676 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.358067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.358682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.358959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.359230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.359895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] RBAC: Adding query filter params (type=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:26.360194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.361569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.366508 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 525/1056] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:26.372966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.400654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.401266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.401565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.401976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.403640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.405555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.407642 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 532/1057] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:26 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:26.413454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.432976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:26.488613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9456-328a-4cb9-9e11-d4fe604e7e29 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.518631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11504-389f-42ff-9cc7-a5aebb69dea3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:26.523052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.523918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.524373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.524650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.525333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.526704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de0a3-998d-49b6-bf16-8f4b745273b2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.547707 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 526/1058] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:57:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:57:26.549171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebd8c-16a3-43ce-a53a-79194bf92a61 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.549450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebd8c-16a3-43ce-a53a-79194bf92a61 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.549722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebd8c-16a3-43ce-a53a-79194bf92a61 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.550952 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 527/1059] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:26.562389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.562615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:26.562861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.563097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.563210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:26.563435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:26.563696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:26.564475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=2d1f31075ce0472b9952edaf058e1dca, user.id=7652e9265b1c474eb2aa98c4c4aa3efc) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:26.564777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:26.566247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:26.581475 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 533/1060] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:26 2022] GET /identity/v3/role_assignments?user.id=7652e9265b1c474eb2aa98c4c4aa3efc&scope.project.id=2d1f31075ce0472b9952edaf058e1dca&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:26.584112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:26.585386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:26.666371 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 528/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:26.930888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:26.940328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:27.034031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d1ac-fdaf-4464-ac76-54c5caf4e609 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.068669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.069340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.069624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.069808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.080326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:27.085481 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:27.086691 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:27.087551 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 534/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:27.093069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:27.128299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:27.195271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ed849-4b28-43bf-9db3-00c41a0761d8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.229071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.229677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.229947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.230206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.230857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:27.231171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:27.232577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:27.240767 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 529/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:27.246875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:27.319561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:27.355694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc034f8-1af3-4d44-8f39-99d2abade829 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.395114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.395766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.396034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.396356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.407261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:27.408743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:27.423685 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:27.424811 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:27.425832 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:27.425832 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:27.425832 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:27.425832 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 535/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:27.431542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:27.537029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:27.544019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc39fd1-fe63-47e1-91a8-7d233300206d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.577324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.577940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.578211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.578476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.579117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:27.579413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:27.580798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:27.598687 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 530/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:27.599921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:27.704410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e591-2129-439f-a59e-b0584792293c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.722709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:27.741794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.742553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.742930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.743292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.751975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:27.753531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:27.764844 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:27.766125 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:27.767336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:27.768854 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 536/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:27.774889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:27.879354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38708-a3e1-4543-8468-3abda801582e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:27.914097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:27.914864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:27.915148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:27.915413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:27.916521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:27.916822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:27.918257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:27.936314 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 531/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:27.941967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.049121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985734f2-1d10-422f-9b42-53eb602b0e9f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:28.082987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:28.083768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.084152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.084567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.095617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:28.097228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:28.112123 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:28.113141 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:28.119430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:28.119430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:28.119430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:28.119430 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 537/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:28.119674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.138429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:28.226289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d44b3-daed-4980-95c3-e045fb380c7d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:28.260402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:28.261022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.261298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.261567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.262219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:28.262518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:28.263929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:28.275822 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 532/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:28.281440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.314075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:28.388291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75b9d2-510e-4c9f-b5dd-d7fb4908916e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:28.424941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:28.425489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.425724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.426023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.433256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:28.434735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ce366bf2-bfda-47e3-8345-e36400571168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:28.446439 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:28.447396 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:28.448879 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:28.449614 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 538/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:28.453672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.507811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd575b-6e37-4906-8e24-589603f8c1ec None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.508790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd575b-6e37-4906-8e24-589603f8c1ec None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.509065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd575b-6e37-4906-8e24-589603f8c1ec None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.510451 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 539/1071] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:28.511581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d728-a4f3-4745-b29a-b04d902c21b6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.511884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d728-a4f3-4745-b29a-b04d902c21b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.512157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d728-a4f3-4745-b29a-b04d902c21b6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.513440 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 540/1072] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:28.516376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2b6b-ea30-4b3d-8479-63ba90c00971 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.516659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2b6b-ea30-4b3d-8479-63ba90c00971 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.516930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2b6b-ea30-4b3d-8479-63ba90c00971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.535356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4f7f2b6b-ea30-4b3d-8479-63ba90c00971 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:28.536584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4f7f2b6b-ea30-4b3d-8479-63ba90c00971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:28.537143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:28.561413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8bdc7-153c-4e03-ab7c-823232f94c80 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:28.594553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:28.595158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.595424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.595687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.596401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:28.596700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:28.598113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:28.603908 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 541/1073] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:28.605139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.605419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.605692 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.610675 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 533/1074] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:28.616375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.622937 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:28.624259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:28.639591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:28.695649 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 542/1075] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:28.734623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5263b-ecff-4bdd-84b8-130ce7ae3fd2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:28.769849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:28.770502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:28.770773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:28.771037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/3e062ab250dd48538897afad11a4425b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:28.773239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=cafb054c1ff2433ca610bd9b50466720, role_id=3e062ab250dd48538897afad11a4425b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:28.774890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:28.778277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:28.791712 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 534/1076] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:57:28 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/cafb054c1ff2433ca610bd9b50466720/roles/3e062ab250dd48538897afad11a4425b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:57:28.874658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.972086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:28.984501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a38721-f3af-4ba8-85ca-a3402325527f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.021088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.021758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.022038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.022303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.042113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:29.079052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b535-e069-4537-9db2-2da7b2c49f86 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.095142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.096637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.116760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.117567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.117879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.118153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.128811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:29.133708 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:29.135045 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:29.136036 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:29.139985 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 535/1077] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:29.140846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.200671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:29.217014 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 543/1078] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:29.218281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.249146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac0df-1166-4edc-a638-778c28a9d01a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.268732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:29.294760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.295378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.295647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.295961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.296628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:29.296921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.298301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.307954 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 536/1079] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:29.313675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.331969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9aa6-8137-423a-9488-237db71632b6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.368691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.369322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.369600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.369875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.382230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.383957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:29.399977 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:29.401051 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:29.402017 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:29.402017 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:29.402017 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:29.406030 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 544/1080] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:29.407068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.423618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048da-bed9-4387-a18c-c40e56950773 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.443542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:29.464251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.464884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.465157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.465422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] PATH_INFO: `/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.466550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] RBAC: Authorizing `identity:get_user(user_id=7652e9265b1c474eb2aa98c4c4aa3efc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.468010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.469588 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 537/1081] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:29 2022] GET /identity/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:29.475329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.523167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce45a-4ed1-4553-a64a-556252b32738 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.525209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:29.558898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.559511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.559810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.560082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.560723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:29.561021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.562406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.575185 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 545/1082] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:29.581628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cdb63-6ca4-4211-b0c2-2ebe3670e630 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.621204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.621872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.622145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.622412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.623609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.625120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deaf8f-8d92-4771-ad98-7f3e30fc485b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.627092 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 538/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:29 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:29.633762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:29.748225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab677dc-8638-4999-982e-6310d2dced8d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:29.786785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:29.787377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:29.787648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:29.787946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca/users/7652e9265b1c474eb2aa98c4c4aa3efc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:29.790539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1f31075ce0472b9952edaf058e1dca, user_id=7652e9265b1c474eb2aa98c4c4aa3efc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:29.792416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3cf0-8b00-4645-a41c-45fe28c29195 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:29.807983 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 546/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:57:29 2022] PUT /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca/users/7652e9265b1c474eb2aa98c4c4aa3efc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:57:30.686428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70832c-3c54-45c7-b3d4-1dc89c3b3958 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:30.687030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70832c-3c54-45c7-b3d4-1dc89c3b3958 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:30.687030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70832c-3c54-45c7-b3d4-1dc89c3b3958 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:30.688298 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 539/1085] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:30.693820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:30.694238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:30.694422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:30.715515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:30.716737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:30.735183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:30.790428 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:31.063234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70832c-3c54-45c7-b3d4-1dc89c3b3958 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.120719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:31.168180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70832c-3c54-45c7-b3d4-1dc89c3b3958 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:31.202959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:31.203588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.203905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.204158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.214979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:31.219652 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:31.220830 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:31.221703 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 540/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:31.227618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.335091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f7c7-9103-4951-8caf-6c25f27e1fd9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:31.369840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:31.370454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.370722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.370981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.371644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:31.371971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:31.373378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:31.381689 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 548/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:31.387486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.495247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d396d-b88d-4793-882f-5ad57fd36c61 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:31.509741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:31.531674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:31.532339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.532609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.532875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.543531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:31.545038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-99f637d5-3fad-47db-acd6-8c79317f492e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:31.560094 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:31.561198 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:31.562657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:31.562657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:31.562657 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:31.562657 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 541/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:31.567302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.584643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:31.671439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94903f7-ebf0-475c-a3b3-d8520801ccca None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:31.694777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc601-c83b-4212-ad4c-a1a82d917e13 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.695573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc601-c83b-4212-ad4c-a1a82d917e13 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.695573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc601-c83b-4212-ad4c-a1a82d917e13 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.696990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 542/1090] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:57:31.701703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.701988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.702259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.706952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:31.707555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.707859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.708140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.708800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:31.709094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:31.710460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:31.720238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:31.721408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:31.722335 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 549/1091] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:31.728393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.791684 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 543/1092] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:57:31.807948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:31.832760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbccf8-37a3-4a7a-8699-1f8a03694171 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:31.867200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:31.867980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:31.868251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:31.868517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:31.875637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:31.877137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:57:31.888449 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:31.889444 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:31.890408 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 550/1093] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:31.895577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:31.991000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:31.997504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024049-0b83-41f5-9670-2c0cd358352f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.032093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.032697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.032977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.033243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.033969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:32.034271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.035701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.052933 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 544/1094] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Aug 21 00:57:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:32.055469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.059023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.156355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d76e-1e1f-4cea-9373-8015f3890f64 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.156972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e62f-d6ed-423b-b786-85730c707c66 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.189578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.190009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.190164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.190455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.190593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.190740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.190865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.191082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.192639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.203272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:32.208101 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:32.209262 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:32.210326 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 551/1095] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:32.215409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.217828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.262346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.263713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.313956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d72-153e-4dc8-8558-36003f9e6890 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.346959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.347562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.347852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.348121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.348788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:32.349088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.350473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.359178 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 552/1096] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:32.365151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.368169 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 545/1097] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:57:32.373818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.421624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.428580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.464797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765679-030b-469f-b8a7-4719ba50c8e7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.471120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4dae-f51d-4241-bda9-f8383f92135a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.498019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.498648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.498920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.499191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] PATH_INFO: `/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.500355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] RBAC: Authorizing `identity:get_user(user_id=7652e9265b1c474eb2aa98c4c4aa3efc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.501788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.503381 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 553/1098] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/users/7652e9265b1c474eb2aa98c4c4aa3efc => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:32.506589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.507224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.507504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.507960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.509291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.518559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.519974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:57:32.534001 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:32.535117 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:57:32.536324 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:57:32.536324 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:57:32.536324 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:32.536324 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 546/1099] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:32.541246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.605963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828abef4-3a55-4ae6-a892-8c64dedcd813 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.633674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.640827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b1fc-aef2-4ea7-a416-eb1fc0a6669b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.645532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.646141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.646422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.646688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.647729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.678203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.678813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.679089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.679364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.680334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:32.680822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.682242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.693339 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 547/1100] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:32.699280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.716651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.718116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.801780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb699ca-30b5-4763-9551-d527b6695b20 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.820451 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 554/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 21 00:57:32.826947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.840148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.840776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.841046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.841283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.848462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.849902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.852783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:57:32.860994 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:32.862097 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:57:32.863318 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:32.867238 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 548/1102] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:32.868139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:32.896869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:32.931546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f7d29-ca05-4033-814a-5f41d9212a70 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.966175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:32.966792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:32.967057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:32.967320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:32.968438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:32.969872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:32.971343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c85b8-4643-4550-8908-972a14b04515 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:32.971494 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 555/1103] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:32.977665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:33.014877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:33.015483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:33.015804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:33.016070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:33.016775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:33.017067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:33.018485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:33.031394 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 549/1104] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:33.037581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:33.073453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:33.082512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b45e-91dc-4e95-813d-d3e5403de6ee None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:33.118046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:33.118645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:33.118911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:33.119173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:33.119928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=2d1f31075ce0472b9952edaf058e1dca, user.id=7652e9265b1c474eb2aa98c4c4aa3efc) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:33.120230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:33.121700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d45bdf-63fe-42d6-9691-77d18471fb3e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:33.123728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:33.128104 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 556/1105] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:32 2022] GET /identity/v3/role_assignments?user.id=7652e9265b1c474eb2aa98c4c4aa3efc&scope.project.id=2d1f31075ce0472b9952edaf058e1dca&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:33.155785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8049d-274a-44c9-bc54-67305033226b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:33.197265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:33.197882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:33.198151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:33.198411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:33.199147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] RBAC: Adding query filter params (role.id=3e062ab250dd48538897afad11a4425b, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=cafb054c1ff2433ca610bd9b50466720) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:33.199446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:33.200920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e17dc-6388-4088-9d44-9a34217d7acc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:33.207725 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 550/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:33 2022] GET /identity/v3/role_assignments?user.id=cafb054c1ff2433ca610bd9b50466720&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=3e062ab250dd48538897afad11a4425b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:35.095280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528b9c-bddb-4815-b667-b50b763d8162 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:35.095915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528b9c-bddb-4815-b667-b50b763d8162 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:35.095915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528b9c-bddb-4815-b667-b50b763d8162 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:35.097221 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 557/1107] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:35.103494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:35.104254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:35.104402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:35.128609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:35.129782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:35.199950 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 551/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:35.482202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528b9c-bddb-4815-b667-b50b763d8162 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:35.594608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528b9c-bddb-4815-b667-b50b763d8162 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:35.636145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:35.636757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:35.637039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:35.637306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:35.638532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:35.640009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913f4f9-ab95-4afd-a164-13d0f6dc2d25 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:35.641560 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 558/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:35.647649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:35.734490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:35.757206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104685-c958-408d-a3bb-a423866d0ae0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:35.791861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905add37-1149-4054-b217-6930f27c7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:35.792461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905add37-1149-4054-b217-6930f27c7574 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:35.792733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905add37-1149-4054-b217-6930f27c7574 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:35.792993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905add37-1149-4054-b217-6930f27c7574 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:35.793624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905add37-1149-4054-b217-6930f27c7574 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:35.795047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905add37-1149-4054-b217-6930f27c7574 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:35.817579 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 552/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:57:35 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:37.819668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4205-f317-4115-8dd8-f9c400c578b0 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:37.820299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4205-f317-4115-8dd8-f9c400c578b0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:37.820590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4205-f317-4115-8dd8-f9c400c578b0 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:37.822036 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 559/1111] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:37.827725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:37.828166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:37.828256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:37.848905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:37.850100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:37.930569 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 553/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:38.202473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4205-f317-4115-8dd8-f9c400c578b0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:38.243982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:38.335159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4205-f317-4115-8dd8-f9c400c578b0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:38.372072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:38.372700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:38.372976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:38.373240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] PATH_INFO: `/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:38.374745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] RBAC: Authorizing `identity:get_role(role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:38.376163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:38.377504 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 560/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:38 2022] GET /identity/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:38.384429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:38.453543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:38.496131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197bea-f7a5-4086-9dca-608d99e426ae None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:38.530925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:38.531551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:38.531859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:38.532125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] PATH_INFO: `/v3/users/72db9dd25cc44bc5b061c375603e1d85` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:38.545919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=72db9dd25cc44bc5b061c375603e1d85)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:38.547364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:38.548990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 554/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:38 2022] GET /identity/v3/users/72db9dd25cc44bc5b061c375603e1d85 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:38.559328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:38.657118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:38.667020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61f2d-c158-48f6-a665-124d501a6abc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:38.705784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:38.706316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:38.706585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:38.706848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:38.779190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:38.780689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:38.873766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:38.885673 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 561/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:38.892060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:39.001829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b812c-9119-43f4-8df5-4263b8199cd1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:39.028691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:39.042359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:39.042986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:39.043253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:39.043518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:39.044772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:39.046228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6cf1-ab4f-4009-aa5d-13825fad70e0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:39.047849 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 555/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:38 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:39.054217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:39.161734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83815fdb-4c28-4a1f-99d0-9b0a0455ffb0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:39.196982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:39.197572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:39.197847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:39.198112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:39.198816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=2d1f31075ce0472b9952edaf058e1dca, user.id=72db9dd25cc44bc5b061c375603e1d85) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:39.199117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:39.200587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c9c8-f695-4f34-8e22-bfc6566316e7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:39.206033 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 562/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:39 2022] GET /identity/v3/role_assignments?user.id=72db9dd25cc44bc5b061c375603e1d85&scope.project.id=2d1f31075ce0472b9952edaf058e1dca&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:41.081680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d68e8-a462-40b2-8c95-818e23456c45 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:41.082507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d68e8-a462-40b2-8c95-818e23456c45 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:41.082507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d68e8-a462-40b2-8c95-818e23456c45 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:41.083823 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 556/1118] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:41.090352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:41.091085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:41.091236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:41.119784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:41.120970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:41.172540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:41.191784 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 563/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:41.453746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d68e8-a462-40b2-8c95-818e23456c45 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:41.571376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d68e8-a462-40b2-8c95-818e23456c45 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:41.606528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:41.607143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:41.607411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:41.607673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] PATH_INFO: `/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:41.609397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] RBAC: Authorizing `identity:get_role(role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:41.610770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:41.612123 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 557/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:41 2022] GET /identity/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:41.622017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:41.746551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe310-62ae-4923-8fd2-487a9fb2588e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:41.781993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:41.782614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:41.782883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:41.783149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] PATH_INFO: `/v3/users/72db9dd25cc44bc5b061c375603e1d85` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:41.784341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] RBAC: Authorizing `identity:get_user(user_id=72db9dd25cc44bc5b061c375603e1d85)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:41.785801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:41.787390 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 564/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:41 2022] GET /identity/v3/users/72db9dd25cc44bc5b061c375603e1d85 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:41.794738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:41.862428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:41.910428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f393-0eb2-43a0-b3fe-8e10f9446979 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:41.946718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:41.947343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:41.947618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:41.947929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:41.949064 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:41.950489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f59187-7e22-42a8-858b-df88adad919f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:41.952153 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 558/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:41 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:41.958471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:42.026141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:42.085798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9b96e-da60-481c-8ba0-4357e0120885 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:42.122580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:42.123401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:42.123766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:42.124114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca/users/72db9dd25cc44bc5b061c375603e1d85/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:42.128169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1f31075ce0472b9952edaf058e1dca, user_id=72db9dd25cc44bc5b061c375603e1d85, role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:42.130453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b65b09-aa6d-4899-8f03-76758a732c07 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:42.147064 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 565/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:57:41 2022] PUT /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca/users/72db9dd25cc44bc5b061c375603e1d85/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:57:44.000594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03dd4-4f70-452d-8453-6d3d3fb7c289 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:44.001205 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03dd4-4f70-452d-8453-6d3d3fb7c289 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:44.001205 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03dd4-4f70-452d-8453-6d3d3fb7c289 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:44.002474 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 559/1124] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:44.008985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:44.009679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:44.009867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:44.032841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:44.034043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:44.112436 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 566/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:44.392089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03dd4-4f70-452d-8453-6d3d3fb7c289 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:44.501473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03dd4-4f70-452d-8453-6d3d3fb7c289 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:44.528814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.537264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:44.537822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:44.538092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:44.538364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] PATH_INFO: `/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:44.540237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] RBAC: Authorizing `identity:get_role(role_id=ec5e3dac21ba4185bec5fea8d67293e1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:44.541974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:44.543281 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 560/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:44 2022] GET /identity/v3/roles/ec5e3dac21ba4185bec5fea8d67293e1 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:44.549889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:44.604969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.671312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341286-5ba3-4a8f-8425-1fa614b17176 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:44.711497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:44.712140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:44.712416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:44.712682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] PATH_INFO: `/v3/users/72db9dd25cc44bc5b061c375603e1d85` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:44.713858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] RBAC: Authorizing `identity:get_user(user_id=72db9dd25cc44bc5b061c375603e1d85)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:44.715315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:44.716974 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 567/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:44 2022] GET /identity/v3/users/72db9dd25cc44bc5b061c375603e1d85 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:44.722956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:44.827467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6977-677f-40d0-96b7-6068fac81466 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:44.863233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:44.863830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:44.864135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:44.864400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:44.926949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.934493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:44.935975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:45.037499 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 561/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:45.044733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:45.154611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b7d9-7078-487d-bce9-6384008ce96e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:45.168820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:45.193954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:45.194600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:45.194903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:45.195132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] PATH_INFO: `/v3/projects/2d1f31075ce0472b9952edaf058e1dca` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:45.196383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] RBAC: Authorizing `identity:get_project(project_id=2d1f31075ce0472b9952edaf058e1dca)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:45.197859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f02a11-975e-4a84-b4c3-95b8b170b60e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:45.199490 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 568/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:45 2022] GET /identity/v3/projects/2d1f31075ce0472b9952edaf058e1dca => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:45.205884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:45.311951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:45.318585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8621-edf6-4097-825b-e53583a91fdc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:45.353274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:45.353871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:45.354146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:45.354412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:45.355131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] RBAC: Adding query filter params (role.id=ec5e3dac21ba4185bec5fea8d67293e1, scope.project.id=2d1f31075ce0472b9952edaf058e1dca, user.id=72db9dd25cc44bc5b061c375603e1d85) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:45.355437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:45.356896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633ec1-cf09-42a7-a737-2d8735a16906 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:45.362755 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 562/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:45 2022] GET /identity/v3/role_assignments?user.id=72db9dd25cc44bc5b061c375603e1d85&scope.project.id=2d1f31075ce0472b9952edaf058e1dca&role.id=ec5e3dac21ba4185bec5fea8d67293e1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:47.321975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fd01-cd99-4e45-9a2f-4441545e5239 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:47.322514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fd01-cd99-4e45-9a2f-4441545e5239 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:47.322514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fd01-cd99-4e45-9a2f-4441545e5239 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:47.323901 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 569/1131] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:47.329401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:47.329841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:47.329933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:47.350863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:47.352313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:47.423290 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 563/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:47.704937 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fd01-cd99-4e45-9a2f-4441545e5239 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:47.821018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fd01-cd99-4e45-9a2f-4441545e5239 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:47.861550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:47.862540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:47.862910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:47.863271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:47.865222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:47.867645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a8d36-cdf4-4e03-9692-cd3584ba313c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:47.869264 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 570/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:47.875316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:47.965542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:47.976167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcb76-8fb6-4687-8e69-38f3238888b6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:48.013008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:48.013619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:48.013890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:48.014156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:48.014793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:48.016285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ec5d0-0ccf-4dc3-b2d1-f119cb801805 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:48.047531 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 564/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:57:47 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:49.962177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f85c-4598-45db-b1a7-105a1c563344 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:49.963092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f85c-4598-45db-b1a7-105a1c563344 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:49.963092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f85c-4598-45db-b1a7-105a1c563344 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:49.965211 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 571/1135] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:49.971488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:49.971981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:49.972080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:49.998325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:49.999527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:50.067999 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 565/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:50.334172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f85c-4598-45db-b1a7-105a1c563344 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:50.394992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:50.456272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f85c-4598-45db-b1a7-105a1c563344 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:50.508452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:50.509081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:50.509358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:50.509627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:50.510856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:50.512352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a4940-3b69-40ef-93b5-6e85e8ec74dc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:50.513941 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 572/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:50.519976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:50.592372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:50.623354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dee5c-7e84-4319-8126-d0db22a83710 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:50.658676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:50.659274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:50.659546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:50.659840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:50.660492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:50.661916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7337863-b0f5-4f33-be0f-841a2555c907 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:50.689693 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 566/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:57:50 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:52.622257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0df8-9df6-47b2-96a4-acf636058306 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.622784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0df8-9df6-47b2-96a4-acf636058306 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.622784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0df8-9df6-47b2-96a4-acf636058306 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.624742 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 573/1139] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:52.633930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:52.634332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:52.634486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:52.664125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:52.665326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:52.735482 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 567/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:53.003109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0df8-9df6-47b2-96a4-acf636058306 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.110844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0df8-9df6-47b2-96a4-acf636058306 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.127118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:53.147183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.147850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.148125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.148390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.158716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:53.163430 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:53.164591 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:53.166084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:53.167906 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 574/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:53.171042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.231374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:53.276105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f0e01-cb8b-4131-a270-9cad446b6bc8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.311706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.312336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.312607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.312871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.313525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:53.313824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.315187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.323686 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 568/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:53.329874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.438190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b5e4-337e-4b4d-826f-a8c458b3ed0d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.473738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.474354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.474631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.474896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] PATH_INFO: `/v3/users/61ba736daacc4e62a079f517fe3cb08b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.488797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] RBAC: Authorizing `identity:get_user(user_id=61ba736daacc4e62a079f517fe3cb08b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.490254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.492122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 575/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/users/61ba736daacc4e62a079f517fe3cb08b => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:53.499125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.602160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe79cb-c115-4b2d-a3e7-de14a0605b4e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.621414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:53.636498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.637115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.637351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.637615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.706803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.708274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.809443 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 569/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:53.815722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:53.856210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:53.930528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee4f-cbc2-42c9-b1ff-810557f134aa None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:53.967187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:53.967842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:53.968148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:53.968409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] PATH_INFO: `/v3/projects/7b48c4cd30864167944a8871898e190d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:53.969601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] RBAC: Authorizing `identity:get_project(project_id=7b48c4cd30864167944a8871898e190d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:53.971059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc573c-d2e2-4280-8170-f23df5671b28 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:53.972753 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 576/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/projects/7b48c4cd30864167944a8871898e190d => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:53.982782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:54.013407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:54.099651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338325-df5f-4f3f-8afd-0d2947b564dc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:54.133709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:54.134299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:54.134574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:54.134830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:54.135531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=7b48c4cd30864167944a8871898e190d, user.id=61ba736daacc4e62a079f517fe3cb08b) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:54.135860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:54.137278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d95ade-ccf6-4a7b-95ee-a87f7d66e76d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:54.142460 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 570/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:57:53 2022] GET /identity/v3/role_assignments?user.id=61ba736daacc4e62a079f517fe3cb08b&scope.project.id=7b48c4cd30864167944a8871898e190d&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:56.058026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5082c-41ab-4604-9c37-ace0393dfd12 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.058599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5082c-41ab-4604-9c37-ace0393dfd12 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.058599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5082c-41ab-4604-9c37-ace0393dfd12 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.059948 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 577/1147] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:56.065415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.065868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.065962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.086974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:56.088190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:56.160101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 571/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:56.440215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5082c-41ab-4604-9c37-ace0393dfd12 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:56.557103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5082c-41ab-4604-9c37-ace0393dfd12 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:56.558669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:56.593659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:56.594273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.594540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.594797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.606082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:56.610797 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:56.611988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:57:56.612952 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 578/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:56.618749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:56.640580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:56.728641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46064a25-b83d-47fa-bf70-373c9f7f67af None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:56.764211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:56.764807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.765073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.765337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.765987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:56.766283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:56.767651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:56.775731 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 572/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:56.782470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:56.894758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25de0-dc15-43bd-9994-9e46246dbf5a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:56.930790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:56.931414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:56.931691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:56.931995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] PATH_INFO: `/v3/users/61ba736daacc4e62a079f517fe3cb08b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:56.933239 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] RBAC: Authorizing `identity:get_user(user_id=61ba736daacc4e62a079f517fe3cb08b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:56.934693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:56.936296 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 579/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:56 2022] GET /identity/v3/users/61ba736daacc4e62a079f517fe3cb08b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:56.942811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:57.036145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:57.059432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851590c-38b4-48ed-8444-22c54f87edde None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:57.094221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:57.094871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:57.095088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:57.095355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] PATH_INFO: `/v3/projects/7b48c4cd30864167944a8871898e190d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:57.096529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] RBAC: Authorizing `identity:get_project(project_id=7b48c4cd30864167944a8871898e190d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:57.097952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45baae0d-dbcb-4a48-ba26-5fd89cf80022 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:57.099575 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 573/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:57:56 2022] GET /identity/v3/projects/7b48c4cd30864167944a8871898e190d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:57:57.106357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:57.142233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:57.225539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79834c0-4413-4efe-a041-a2a0641a240c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:57.263141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:57.263785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:57.264091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:57.264363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] PATH_INFO: `/v3/projects/7b48c4cd30864167944a8871898e190d/users/61ba736daacc4e62a079f517fe3cb08b/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:57.266508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b48c4cd30864167944a8871898e190d, user_id=61ba736daacc4e62a079f517fe3cb08b, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:57.267992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e8d3-bcc5-40df-87ea-2aabf7cd3509 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:57.285573 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 580/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:57:57 2022] PUT /identity/v3/projects/7b48c4cd30864167944a8871898e190d/users/61ba736daacc4e62a079f517fe3cb08b/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:57:59.157074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb20e-41da-4bd8-a1cc-84a28c62341d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:59.158001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb20e-41da-4bd8-a1cc-84a28c62341d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:59.158001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb20e-41da-4bd8-a1cc-84a28c62341d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:59.159991 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 574/1154] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:57:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:57:59.168284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:59.168704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:59.168858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:59.197847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:57:59.199613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:57:59.293587 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 581/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:57:59.559773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb20e-41da-4bd8-a1cc-84a28c62341d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:59.682579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb20e-41da-4bd8-a1cc-84a28c62341d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:59.719757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:59.720376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:59.720652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:59.720916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:59.732716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:57:59.737452 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:57:59.738530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:57:59.740305 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 575/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:57:59.747615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:59.769750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:59.850510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35bae7-6f9a-475b-bf59-1db9b9ffb20c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:57:59.886849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:57:59.887447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:57:59.887717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:57:59.888014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:57:59.888680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:57:59.888976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:57:59.890362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:57:59.898904 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 582/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:57:59.905652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:57:59.912585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:00.022344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5af9b-6569-4a2b-b469-c3831245342c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:00.059765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:00.060412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:00.060682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:00.060940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] PATH_INFO: `/v3/users/61ba736daacc4e62a079f517fe3cb08b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:00.062108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] RBAC: Authorizing `identity:get_user(user_id=61ba736daacc4e62a079f517fe3cb08b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:00.063536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:00.065137 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 576/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:57:59 2022] GET /identity/v3/users/61ba736daacc4e62a079f517fe3cb08b => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:00.071778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:00.162171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:00.184073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a6cc-b5c3-460c-a5d9-4c36015d6b9b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:00.227820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:00.229638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:00.229901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:00.230170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:00.305983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:00.307447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:00.391697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:00.422060 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 583/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:58:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:00.430885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:00.508618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:00.539503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f14847-8a32-41c7-a081-b5c32add88be None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:00.573920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:00.574607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:00.574875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:00.575138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] PATH_INFO: `/v3/projects/7b48c4cd30864167944a8871898e190d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:00.576315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] RBAC: Authorizing `identity:get_project(project_id=7b48c4cd30864167944a8871898e190d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:00.577751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8535c-6e51-4359-b655-715210a2ba22 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:00.579376 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 577/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:58:00 2022] GET /identity/v3/projects/7b48c4cd30864167944a8871898e190d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:00.586981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:00.693909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9499968-dc53-45c7-9171-46b34b2c4a6c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:00.727782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:00.728388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:00.728658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:00.728920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:00.729633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=7b48c4cd30864167944a8871898e190d, user.id=61ba736daacc4e62a079f517fe3cb08b) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:00.729942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:00.731378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c25da-dba6-4293-8fdc-71071b4efb13 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:00.737221 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 584/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:58:00 2022] GET /identity/v3/role_assignments?user.id=61ba736daacc4e62a079f517fe3cb08b&scope.project.id=7b48c4cd30864167944a8871898e190d&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:02.647591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec551-fec2-4ddc-88b3-8d7a48d35c58 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:02.648185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec551-fec2-4ddc-88b3-8d7a48d35c58 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:02.648185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec551-fec2-4ddc-88b3-8d7a48d35c58 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:02.649498 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 578/1162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:02.655890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:02.656741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:02.656741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:02.685072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:02.686262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:02.733191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:02.759770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 585/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:58:03.042709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ec551-fec2-4ddc-88b3-8d7a48d35c58 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:03.154710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ec551-fec2-4ddc-88b3-8d7a48d35c58 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:03.191721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:03.192352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:03.192622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:03.192888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:03.203671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:03.262837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:03.264312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:03.368899 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 579/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:58:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:03.375565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:03.486213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64cc70-d23c-4815-9ca6-6f94cb9eda05 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:03.521827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:03.522447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:03.522797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:03.523256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:03.530195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:03.531641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3d7908fe-a4ba-4f06-8525-37445794cf78 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:58:03.544569 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:58:03.545759 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:58:03.546836 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 586/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:58:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:58:03.554316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:03.615615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:03.684804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eef0a-3a65-4efc-8cd3-233257a4ab2d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:03.721610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:03.722213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:03.722486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:03.722751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:03.723387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:03.723683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:03.725080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab780e-3c5f-4eff-9285-9340d2e92174 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:03.732200 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 580/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Aug 21 00:58:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:05.615675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a79d-f1c6-4156-a3c8-412b089ee0e2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:05.616531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a79d-f1c6-4156-a3c8-412b089ee0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:05.616531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a79d-f1c6-4156-a3c8-412b089ee0e2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:05.618624 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 587/1167] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:05.627314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a560-b33c-4273-b48c-7179b67744da None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:05.627769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a560-b33c-4273-b48c-7179b67744da None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:05.627907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a560-b33c-4273-b48c-7179b67744da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:05.655024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3ad8a560-b33c-4273-b48c-7179b67744da None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:05.656259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3ad8a560-b33c-4273-b48c-7179b67744da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:05.727144 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 581/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:58:06.001728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a79d-f1c6-4156-a3c8-412b089ee0e2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:06.044438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:06.120295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a79d-f1c6-4156-a3c8-412b089ee0e2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:06.164278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:06.165200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:06.165999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:06.166404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:06.167469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:06.169685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aed7e-b6f2-4fca-b75d-7393eb1f19d4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:06.191295 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 588/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Sun Aug 21 00:58:06 2022] POST /identity/v3/domains => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:58:08.067625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d729-c84b-4bdd-9c80-f6082ef9ea52 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.068607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d729-c84b-4bdd-9c80-f6082ef9ea52 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.068607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d729-c84b-4bdd-9c80-f6082ef9ea52 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.071812 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 582/1170] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:08.077475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.077915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.078027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.097509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:08.098683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:08.171689 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 589/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:58:08.444241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801d729-c84b-4bdd-9c80-f6082ef9ea52 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:08.490110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:08.559518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801d729-c84b-4bdd-9c80-f6082ef9ea52 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:08.597067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:08.597693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.597975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.598236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] PATH_INFO: `/v3/domains/127783930892403b86f219032b41970a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.610754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=127783930892403b86f219032b41970a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:08.612229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d534ed-5762-4ebf-9e64-6e4d1ea516cf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:08.613843 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 583/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Aug 21 00:58:08 2022] GET /identity/v3/domains/127783930892403b86f219032b41970a => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:08.620206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:08.647803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:08.721791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1d40-a644-4235-9ba9-fd90fe851a73 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:08.757052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:08.757685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:08.758053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:08.758337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:08.758995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:08.760487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20b0d7-b895-4543-81d8-1227e6829b72 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:08.792001 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 590/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:58:08 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:58:10.730233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4077a-2bcd-476a-87ad-d713e8acd111 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.731263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4077a-2bcd-476a-87ad-d713e8acd111 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.731263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4077a-2bcd-476a-87ad-d713e8acd111 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.733309 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 584/1174] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:10.742744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:10.743186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:10.743297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:10.769913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:10.771101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:10.845185 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 591/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:58:11.110834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4077a-2bcd-476a-87ad-d713e8acd111 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:11.221667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.235188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4077a-2bcd-476a-87ad-d713e8acd111 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:11.279160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:11.279785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.280073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.280334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] PATH_INFO: `/v3/domains/127783930892403b86f219032b41970a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.281452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] RBAC: Authorizing `identity:get_domain(domain_id=127783930892403b86f219032b41970a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:11.282896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841337c9-ea01-47aa-875d-80a20c9e960a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:11.284469 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 585/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Aug 21 00:58:11 2022] GET /identity/v3/domains/127783930892403b86f219032b41970a => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:11.290842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:11.301591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.392755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ada2a-fc8b-47b3-8da9-3967f3d9970c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:11.427776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:11.428415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.428683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.429130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.429610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:11.431053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b805e-5a29-4ab5-a110-476d65f9f387 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:11.459355 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 592/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:58:11 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:58:13.403295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24200-e314-4551-a9bd-126d4240522d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:13.404251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24200-e314-4551-a9bd-126d4240522d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:13.404251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24200-e314-4551-a9bd-126d4240522d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:13.406356 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 586/1178] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:13.412863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:13.413310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:13.413411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:13.433341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:13.434540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:13.496096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:13.510268 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 593/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:58:13.783285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24200-e314-4551-a9bd-126d4240522d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:13.902602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24200-e314-4551-a9bd-126d4240522d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:13.938572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:13.939182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:13.939415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:13.939699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:13.950645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:58:13.955317 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:58:13.956530 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:58:13.957479 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 587/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:58:13.962696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:14.064815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a281571-36c2-4deb-b9de-e884a5a38843 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.101560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.102163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.102434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.102701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.103368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:14.103665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.105077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.113302 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 594/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:14.119291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:14.145113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:14.231998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731b93d-967d-4532-bda9-c1dadf08ed0c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.271024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342639-6595-4177-8644-cebc4b565225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.271650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342639-6595-4177-8644-cebc4b565225 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.272007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342639-6595-4177-8644-cebc4b565225 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.272401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342639-6595-4177-8644-cebc4b565225 None admin] PATH_INFO: `/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.289447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342639-6595-4177-8644-cebc4b565225 None admin] RBAC: Authorizing `identity:get_user(user_id=c75e3911fe7e43fd837d8cfb34c7ec81)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.291028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342639-6595-4177-8644-cebc4b565225 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.292726 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 588/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:58:14 2022] GET /identity/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:58:14.298912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:14.356654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:14.409787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df3bf-bd48-4c9a-9ca4-a51ca659a479 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.444758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.445411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.445606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.445869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.520740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.522438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.580695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:14.632255 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 595/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:58:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:14.641047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342639-6595-4177-8644-cebc4b565225 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:14.726003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:14.748101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342639-6595-4177-8644-cebc4b565225 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.783339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.783988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.784259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.784522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] PATH_INFO: `/v3/projects/2ced85ea8d2f4778bde155c821d49ed3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.785684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] RBAC: Authorizing `identity:get_project(project_id=2ced85ea8d2f4778bde155c821d49ed3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.787138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2918f-56ad-4135-957c-7189cb6ac876 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.788890 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 589/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:58:14 2022] GET /identity/v3/projects/2ced85ea8d2f4778bde155c821d49ed3 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:58:14.798935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:14.904849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ae31-3502-44a7-b7df-1207efc47fac None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:14.949640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:14.950240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:14.950516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:14.950782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:14.951506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=2ced85ea8d2f4778bde155c821d49ed3, user.id=c75e3911fe7e43fd837d8cfb34c7ec81) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:14.951853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:14.953294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63a1b-56d6-4443-bc95-21f343e314ca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:14.959154 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 596/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:58:14 2022] GET /identity/v3/role_assignments?user.id=c75e3911fe7e43fd837d8cfb34c7ec81&scope.project.id=2ced85ea8d2f4778bde155c821d49ed3&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:16.830569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dffc59-2d0b-4425-af55-275438b40200 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:16.831497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dffc59-2d0b-4425-af55-275438b40200 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:16.831497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dffc59-2d0b-4425-af55-275438b40200 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:16.833528 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 590/1186] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:16.842027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:16.842471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:16.842583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:16.862285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:16.863455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:16.877955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:16.940467 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 597/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:58:17.213944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dffc59-2d0b-4425-af55-275438b40200 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:17.326316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dffc59-2d0b-4425-af55-275438b40200 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:17.364928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:17.365593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:17.366122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:17.366427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:17.377336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:58:17.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:58:17.387706 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:58:17.388766 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 591/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:58:17.394920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:17.509122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464501-037f-48ed-bb7e-1a09a588d134 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:17.547360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:17.547991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:17.548264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:17.548531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:17.549200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:17.549500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:17.550885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:17.559234 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 598/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:17.565351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:17.577680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:17.674851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc88ed-5214-4816-ac91-ceffcced4ad0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:17.714584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:17.715206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:17.715472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:17.715768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] PATH_INFO: `/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:17.716887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] RBAC: Authorizing `identity:get_user(user_id=c75e3911fe7e43fd837d8cfb34c7ec81)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:17.718351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:17.719920 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 592/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:58:17 2022] GET /identity/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:17.727952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:17.744347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:17.831613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbf55-a1b3-4ee9-b077-bb6ef6fc8fd2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:17.865862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:17.866479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:17.866728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:17.866994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] PATH_INFO: `/v3/projects/2ced85ea8d2f4778bde155c821d49ed3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:17.868170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] RBAC: Authorizing `identity:get_project(project_id=2ced85ea8d2f4778bde155c821d49ed3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:17.869609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1ea06-50b5-43ce-84a3-a5a936e79e27 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:17.871217 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 599/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:58:17 2022] GET /identity/v3/projects/2ced85ea8d2f4778bde155c821d49ed3 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:17.880842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:17.967968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:17.994384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed264-29a3-44f6-a7ef-ccd781267b2f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:18.030935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:18.031587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:18.031896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:18.032166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] PATH_INFO: `/v3/projects/2ced85ea8d2f4778bde155c821d49ed3/users/c75e3911fe7e43fd837d8cfb34c7ec81/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:18.034311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] RBAC: Authorizing `identity:create_grant(project_id=2ced85ea8d2f4778bde155c821d49ed3, user_id=c75e3911fe7e43fd837d8cfb34c7ec81, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:18.035766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7827-0f68-4bc8-8f5c-f240683c51ab None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:18.052735 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 593/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:58:17 2022] PUT /identity/v3/projects/2ced85ea8d2f4778bde155c821d49ed3/users/c75e3911fe7e43fd837d8cfb34c7ec81/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:58:19.934721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120582-4ac5-4639-87ac-ec684fe1e82b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.935592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120582-4ac5-4639-87ac-ec684fe1e82b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.935592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120582-4ac5-4639-87ac-ec684fe1e82b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:19.937692 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 600/1193] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:19.943240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.943811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.943932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:19.963507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:19.964710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:20.039612 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 594/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:58:20.322946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120582-4ac5-4639-87ac-ec684fe1e82b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:20.432877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:20.464855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120582-4ac5-4639-87ac-ec684fe1e82b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:20.502169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:20.502798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:20.503068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:20.503330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:20.514313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:58:20.518987 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:58:20.520054 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:58:20.520971 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 601/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:58:20.526790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:20.596197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:20.631135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a0fa-e3aa-4865-9f78-4481427b6554 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:20.667727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:20.668355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:20.668598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:20.668894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:20.669540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:20.669833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:20.671188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:20.679455 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 595/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:20.686331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:20.804829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3bdd-9e3c-4a18-9cb1-d588a6befd48 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:20.840071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:20.840683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:20.840954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:20.841220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] PATH_INFO: `/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:20.842449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] RBAC: Authorizing `identity:get_user(user_id=c75e3911fe7e43fd837d8cfb34c7ec81)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:20.843923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:20.845507 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 602/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Aug 21 00:58:20 2022] GET /identity/v3/users/c75e3911fe7e43fd837d8cfb34c7ec81 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:20.852744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:20.956374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f294-6e95-48fb-942f-6e6c0fe39acf None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:20.982678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:20.994680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:20.995290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:20.995563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:20.995871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:21.065568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:21.067014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:21.167994 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 596/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:58:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:21.174824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:21.187664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:21.304074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8df9d-2b29-4e43-be4e-a7f5ef8d92c9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:21.339657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:21.340316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:21.340588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:21.340857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] PATH_INFO: `/v3/projects/2ced85ea8d2f4778bde155c821d49ed3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:21.342037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ced85ea8d2f4778bde155c821d49ed3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:21.343483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8657-397a-4800-a406-f5187d5840f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:21.345180 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 603/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Aug 21 00:58:21 2022] GET /identity/v3/projects/2ced85ea8d2f4778bde155c821d49ed3 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:21.351983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:21.382978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:21.456412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614f51-2e87-4126-bf53-3f7ab944c886 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:21.491527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:21.496683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:21.498105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:21.498386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:21.499119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=2ced85ea8d2f4778bde155c821d49ed3, user.id=c75e3911fe7e43fd837d8cfb34c7ec81) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:58:21.499423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:21.500901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b06db-8b77-4a5c-9cfd-a20700b3828e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:21.506829 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 597/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:58:21 2022] GET /identity/v3/role_assignments?user.id=c75e3911fe7e43fd837d8cfb34c7ec81&scope.project.id=2ced85ea8d2f4778bde155c821d49ed3&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:58:31.334291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=62 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:31.504532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=54 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:17.387649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2266f-cbaa-414a-abe7-58912de83d5d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:17.388316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2266f-cbaa-414a-abe7-58912de83d5d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:17.388316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2266f-cbaa-414a-abe7-58912de83d5d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:17.389744 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 604/1201] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:17.398571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:17.399117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:17.399117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:17.420732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:17.422163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:17.520647 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 598/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:17.801997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2266f-cbaa-414a-abe7-58912de83d5d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:17.935957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2266f-cbaa-414a-abe7-58912de83d5d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:17.975785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:17.976607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:17.976915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:17.977216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:17.989194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:17.991448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:18.008232 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:18.009640 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:18.010690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:18.010690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:18.010690 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:18.012340 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 605/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:18.015788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:18.141487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b6a41-9981-4ed7-9405-b6e63c1787b4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:18.176702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:18.185073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:18.185763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:18.186220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:18.186546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:18.187266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:18.187571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:18.189419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b0dd-3bb8-463e-933c-fea143d385f2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:18.203654 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 599/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:18.209858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:18.275567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:18.339280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5609-fb85-4dad-b4cb-fae2b9ad8315 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:18.384275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:18.384948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:18.385304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:18.385492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:18.386430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:18.387915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0f70-4fd1-48e9-8492-ce27ff73fd65 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:18.417923 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 606/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Aug 21 00:59:18 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:59:20.571597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff70905-039c-4379-8021-a964ea1fc1ba None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:20.572178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff70905-039c-4379-8021-a964ea1fc1ba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:20.572178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff70905-039c-4379-8021-a964ea1fc1ba None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:20.573996 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 600/1206] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:20.581821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:20.582325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:20.582421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:20.604298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:20.606075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:20.687195 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 607/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:20.978039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff70905-039c-4379-8021-a964ea1fc1ba None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.109909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff70905-039c-4379-8021-a964ea1fc1ba None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.153054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.153677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.154167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.154434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.166300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:21.171119 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:21.172526 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:21.173457 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 601/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:59:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:21.179043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.226280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:21.307036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388c51-bd28-4221-b812-f807021bee8c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.343540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.344281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.344559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.344942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.345689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:21.346114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:21.347634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:21.356751 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 608/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:21.362807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.429830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:21.482260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2082-5b18-4559-b0e2-61739de4e834 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.524073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.524774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.525086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.525310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.536015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:21.537618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:21.553559 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:21.554776 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:21.555786 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:21.555786 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:21.555786 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:21.555786 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 602/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:21.561263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.679228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:21.682977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407770-b84d-4e54-9d2b-1b1c4e50af1a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.725933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.726718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.726828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.727127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.727721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:21.728083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:21.729607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:21.748009 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 609/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:21.749691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.874906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ebf6-b9bc-4e62-9f97-2005c7f8a2ae None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.876518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:21.917508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.918147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.918418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.918680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.926558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:21.928859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:21.943400 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:21.944576 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:21.945561 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 603/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:21.950668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:22.079319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cced18-5864-4adb-8261-12718b1e266a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:22.118124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:22.119188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:22.119460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:22.119722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:22.120502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:22.120797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:22.122232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:22.143186 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 610/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:22.149727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:22.275265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d80217-841b-4054-9655-fd56e9390f53 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:22.321527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:22.322220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:22.322553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:22.322811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:22.361337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:22.415859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:22.415859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:22.528241 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 604/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:59:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:59:22.534809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:22.558227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:22.653615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6786-d14a-4354-824d-859dc56d5fe4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:22.690656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:22.691336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:22.691600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:22.691824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:22.705018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:22.706800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:22.724358 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:22.725491 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:22.731619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:22.731619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:22.731619 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:22.731619 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 611/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:59:22.731907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:22.799919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:22.844989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b96025-2f6b-43de-9072-5fb91045cf36 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:22.890245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:22.891286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:22.891634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:22.891909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:22.892612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:22.892912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:22.894286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:22.907474 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 605/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:22.914206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:22.995235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:23.030162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb011-883f-4a4d-9e0d-38005e783a69 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:23.069944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:23.070586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:23.070865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:23.071134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:23.078211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:23.079679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:23.090901 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:23.091895 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:23.092824 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:23.095949 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 612/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:23.098340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:23.214277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf363526-2e9e-4571-8b56-ffecf2606e36 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:23.243821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:23.258296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:23.259261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:23.259780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:23.260266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:23.261009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:23.261305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:23.262824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40448d30-fabb-4c59-be2c-b8ebf375a37b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:23.276195 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 606/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:23.283053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:23.414134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8587f1f-3b3e-4577-9ac8-156d6b94cc13 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:23.453156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:23.459916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:23.460576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:23.460884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:23.461173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:23.461960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=167a92c0eb6d4e609b369e8c359b94cd) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:23.462269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:23.463842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898836b1-6377-4981-97e0-aaaf01901595 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:23.469920 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 613/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:59:23 2022] GET /identity/v3/role_assignments?user.id=167a92c0eb6d4e609b369e8c359b94cd&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:25.625803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412f96d-397c-4fd3-9ed2-bf029a5a4fc2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:25.626436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412f96d-397c-4fd3-9ed2-bf029a5a4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:25.626436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412f96d-397c-4fd3-9ed2-bf029a5a4fc2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:25.627971 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 607/1220] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:25.633800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:25.634299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:25.634395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:25.654595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:25.655849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:25.728277 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 614/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:26.028311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412f96d-397c-4fd3-9ed2-bf029a5a4fc2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.142735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412f96d-397c-4fd3-9ed2-bf029a5a4fc2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.179032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.179672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.179980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.180247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.191591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:26.197072 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:26.198556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:26.199622 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 608/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:26.204727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.312333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b711-1d1c-437c-80fc-79fed26cfb9b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.335501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:26.345845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.346448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.346720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.346986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.347645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:26.347967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:26.349347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:26.357510 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 615/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:26.363393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.420131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:26.491348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cfad-e026-4cdd-b5e6-ee3671cc3316 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.530138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.530911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.531194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.531540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.543523 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:26.544950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:26.559979 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:26.561146 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:26.562067 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:26.562067 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:26.562067 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:26.562067 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 609/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:26.567198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.668961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680103-9cb1-4144-8fb5-2c7ed410e6a9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.702541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.703141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.703412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.703711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.704341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:26.704631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:26.706177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:26.718565 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 616/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:26.724582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.831297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:26.838706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc658-127f-4be9-bb3b-08d28d4b3345 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.875137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.875794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.876126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.876329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.888012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:26.889790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:26.904058 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:26.905332 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:26.906294 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:26.907006 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 610/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:26.913295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:26.962553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:27.022041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e6d4-6893-4343-8619-df3f3a2d7ff3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.058099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.058844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.059127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.059601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:27.060521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:27.061001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:27.062709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:27.080997 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 617/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:27.087839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:27.201237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0df1-3f2b-4446-bc55-b8dd2d4f2dd2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.239311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.239980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.240263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.240881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:27.251550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:27.253037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:27.268039 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:27.269250 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:27.270374 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:27.270374 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:27.270374 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:27.270374 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 611/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:27.276164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:27.388322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3cd7-d8e5-4701-878b-4a4e529d0abe None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.390671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:27.430633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.431251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.431536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.431824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:27.432468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:27.432768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:27.434155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:27.446713 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 618/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:27.453649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:27.464269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:27.568589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731f98-6f23-464d-b8f8-be23eeea3b36 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.605069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.605717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.606037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.606280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:27.613909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:27.615491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:27.628584 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:27.629705 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:27.630921 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 612/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:27.636754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:27.748801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9cee-6856-4236-9435-5b84e22c62a0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.787658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.788424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.788648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.788914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:27.790040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:27.790314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:27.791775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca70e-58e6-494e-a0a5-3b5373ce95d9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:27.805213 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 619/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:27.812042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:27.890926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:27.937418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ab182-6d7e-4508-8904-5cfff7bd31d4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:27.984409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:27.985467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:27.985930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:27.986391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/167a92c0eb6d4e609b369e8c359b94cd/roles/a2fcf88965da4e8dad6ac689c10a5d7d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:28.012156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=167a92c0eb6d4e609b369e8c359b94cd, role_id=a2fcf88965da4e8dad6ac689c10a5d7d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:28.015326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdea97-dc67-4614-8f91-de433284e2f3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:28.033224 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 613/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:59:27 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/167a92c0eb6d4e609b369e8c359b94cd/roles/a2fcf88965da4e8dad6ac689c10a5d7d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:59:29.959482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a12d-55fb-45b8-a98e-7a1075e44d6a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:29.960116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a12d-55fb-45b8-a98e-7a1075e44d6a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:29.960291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a12d-55fb-45b8-a98e-7a1075e44d6a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:29.962187 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 620/1233] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:29.967613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:29.968269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:29.968269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:29.986633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:29.987893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:30.057682 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 614/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:30.320808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9a12d-55fb-45b8-a98e-7a1075e44d6a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:30.346589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:30.436434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9a12d-55fb-45b8-a98e-7a1075e44d6a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:30.476041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:30.476682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.476957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.477225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.492106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:30.496859 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:30.497950 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:30.498836 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 621/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Aug 21 00:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:59:30.504222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:30.553214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:30.608278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbd179-8851-496f-bf39-9821c9d604f3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:30.645334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:30.645334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.645334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.645334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.645776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:30.645776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:30.645776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:30.653065 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 615/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Aug 21 00:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:30.658901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:30.745024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:30.761086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5361eef-62b0-404b-8a55-b20f31504614 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:30.796124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:30.796752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.797025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.797291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.807992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:30.809387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:30.826838 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:30.827896 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:30.828818 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:30.828818 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:30.828818 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:30.828818 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 622/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:30.834271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:30.938309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb438-b666-403a-a95b-5d3cc537ae49 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:30.947329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:30.975081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:30.975840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.976106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.976397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.977070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:30.977375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:30.978925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:30.992077 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 616/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:30.998076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:31.112047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633e5-f76b-45c6-97d3-9eb069ddb8f4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:31.149716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:31.150348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.150624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.150894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.153632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:31.159206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:31.160990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:31.174077 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:31.175269 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:31.176347 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 623/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:59:31.181629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:31.290280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ffe87-a54f-4b09-8582-7a3264710d8f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:31.333761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:31.334676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.334958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.335254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.336118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:31.336538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:31.338209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:31.356362 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 617/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:31.362668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:31.485431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642eba-f961-4264-acca-037bd41f2e49 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:31.525423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:31.526062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.526334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.526599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.594852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:31.603383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:31.605427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:31.719182 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 624/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:59:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:59:31.725640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:31.756139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:31.836617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26e21-c723-498d-b981-842f4231dcf3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:31.877496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:31.878233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.878626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.879087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.893420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:31.895338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:31.913315 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:31.915003 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:31.916043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:31.916043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:31.916043 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:31.916043 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 618/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:31.923663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:32.022025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:32.028405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2881-7a28-46e0-a706-9d9dc6154b15 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:32.065156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:32.065773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.066046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.066310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.067063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:32.067400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:32.069175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:32.081480 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 625/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:32.088255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:32.173423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:32.197371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f81c5-024c-4d2f-aa4b-5c361420b010 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:32.232921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:32.233556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.233828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.234091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.240984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:32.242614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:32.255030 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:32.256297 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:32.257246 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 619/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:32.265888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:32.389334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d210f8-0ae0-4d58-9e90-4d43b56cf846 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:32.428152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:32.428794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.429138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.429402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.430241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:32.430578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:32.432148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96849-9c9c-4548-9de0-e4c69685c047 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:32.445627 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 626/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:32.451837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:32.568846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495cc8-c803-4e67-9aa2-eb7f3dfafc43 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:32.607308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:32.607987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.608272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.608538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.609402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] RBAC: Adding query filter params (role.id=a2fcf88965da4e8dad6ac689c10a5d7d, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=167a92c0eb6d4e609b369e8c359b94cd) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:32.609725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:32.611327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc90f4-a503-42bb-9b11-8fbe03ee6a89 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:32.619159 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 620/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:59:32 2022] GET /identity/v3/role_assignments?user.id=167a92c0eb6d4e609b369e8c359b94cd&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=a2fcf88965da4e8dad6ac689c10a5d7d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:34.696844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8035da-bbf8-46ac-80ee-650b0027fdd2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:34.697465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8035da-bbf8-46ac-80ee-650b0027fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:34.697465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8035da-bbf8-46ac-80ee-650b0027fdd2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:34.699199 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 627/1247] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:34.705370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c657-f251-47ab-864e-a119bf8390af None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:34.705830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c657-f251-47ab-864e-a119bf8390af None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:34.705939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c657-f251-47ab-864e-a119bf8390af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:34.712315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:34.726224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e913c657-f251-47ab-864e-a119bf8390af None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:34.727434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e913c657-f251-47ab-864e-a119bf8390af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:34.800702 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 621/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:59:35.099158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8035da-bbf8-46ac-80ee-650b0027fdd2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.120680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.218033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8035da-bbf8-46ac-80ee-650b0027fdd2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.258732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:35.259515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:35.259842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:35.260114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:35.271358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:35.279084 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:35.280340 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:35.281336 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 628/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:35.289808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c657-f251-47ab-864e-a119bf8390af None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.404943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c657-f251-47ab-864e-a119bf8390af None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.441104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.447812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:35.448456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:35.448749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:35.449089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:35.449890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:35.450256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:35.451864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:35.461061 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 622/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:35.467195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.558304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.585299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ffee5-01cb-4af1-aad1-e5d23782628d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.624349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:35.625098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:35.625371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:35.625666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:35.638051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:35.639553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:35.656656 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:35.657830 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:35.658988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:35.658988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:35.658988 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:35.658988 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 629/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:35.665600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.782257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a0e-6088-4108-9fd1-0ee398d439b8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.821330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:35.821948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:35.822250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:35.822512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:35.823206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:35.823544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:35.825133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:35.837810 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 623/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:35.843727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.963226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41cb0-abe5-4c0d-bee3-9d0106a0e318 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.994057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:36.002621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:36.003391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:36.003673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:36.003969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:36.012569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:36.014025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:36.026057 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:36.027450 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:36.029877 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 630/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:36.033471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:36.094855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:36.144049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d6fe-250c-400d-b271-6c77e8059a13 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:36.184365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:36.185132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:36.185439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:36.185729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:36.186607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:36.186969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:36.188429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:36.209402 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 624/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:36.215694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:36.344944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79b93-1ea1-48a6-a766-501be6bfa29d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:36.382790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:36.383455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:36.383762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:36.383762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:36.452151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:36.468170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:36.469747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:36.582861 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:59:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:59:36.589533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:36.701337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be45f4-bb4c-4125-ba7b-12e0757da1d8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:36.716735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:36.746125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:36.746762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:36.747086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:36.747385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:36.759359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:36.761103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:36.776556 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:36.777906 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:36.779293 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:36.779293 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:36.779293 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:36.779293 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 625/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:36.783586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:36.882021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:36.894969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5a36c-ee0d-47f6-bd77-429d04baa3b9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:36.938056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:36.938807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:36.939083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:36.939388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:36.940112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:36.940436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:36.941897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:36.955288 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 632/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:36.961324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:37.074101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921e344-a8f2-4e6b-bfcf-966dd10c3379 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:37.113842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:37.114515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:37.114825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:37.115267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:37.125564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:37.127164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:37.140435 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:37.141719 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:37.143269 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 626/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:37.148174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:37.257970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2fe3-b253-464e-bd16-e9645addf3de None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:37.297750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:37.298453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:37.298789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:37.299103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:37.299875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:37.300196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:37.301897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75316-17fa-44a3-9fac-9f6f9e4f5c3a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:37.317106 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 633/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:37.325609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:37.357610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:37.444560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e67d5-64e0-41c8-8af1-bf5bf4793d18 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:37.480295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:37.480906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:37.481184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:37.481452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:37.482178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=167a92c0eb6d4e609b369e8c359b94cd) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:37.482487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:37.483946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b48e-b208-4170-9332-85fc31db2a3f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:37.491814 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 627/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:59:37 2022] GET /identity/v3/role_assignments?user.id=167a92c0eb6d4e609b369e8c359b94cd&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:39.446671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95b74-dac3-46ce-a183-853eab58226c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.447531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95b74-dac3-46ce-a183-853eab58226c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.447531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95b74-dac3-46ce-a183-853eab58226c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.449768 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 634/1261] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:39.455283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.455705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.455847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.475713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:39.476915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.547514 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 628/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:39.814822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95b74-dac3-46ce-a183-853eab58226c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:39.832582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:39.937781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95b74-dac3-46ce-a183-853eab58226c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:39.977878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:39.978492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.978764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.979029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.991294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:39.996014 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:39.997166 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:39.998055 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 635/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:40.003441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:40.022039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:40.122456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a084-8334-4923-8915-6e54ae9a8a05 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:40.161696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:40.162348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:40.162636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:40.162888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:40.163538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:40.163862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:40.165602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:40.173665 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 629/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:40.182931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:40.254485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:40.289812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1215f31-903b-41c3-a4c2-2c1923ecf8ad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:40.326334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:40.327271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:40.327622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:40.327922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:40.345148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:40.347495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:40.365714 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:40.366705 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:40.368188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:40.368188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:40.368188 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:40.368188 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 636/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:40.375659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:40.463211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:40.484729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada8cb4-46c2-4824-9ae7-c86e042e372f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:40.517882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:40.518477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:40.518756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:40.519021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:40.519654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:40.519976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:40.521429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:40.533871 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 630/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:40.541040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:40.653208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3cd1-2b3d-420f-8d7c-6a651c37879e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:40.673294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:40.691763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:40.692413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:40.692686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:40.692956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:40.701625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:40.703097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:40.714836 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:40.715945 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:40.717310 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 637/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:40.724389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:40.836311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f17b6f-d41a-4ffe-b8ef-4effb3acf267 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:40.873407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:40.874121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:40.874481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:40.874746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:40.875543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:40.875928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:40.877541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:40.888504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:40.899431 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 631/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:40.906335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:41.015447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c955a7-da0a-4762-a2be-af84594271e8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:41.061754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:41.062811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.063307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.063785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.076447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:41.077893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:41.093488 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:41.094548 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:41.096339 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:41.096339 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:41.096339 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:41.096339 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 638/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:41.104238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:41.208153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495cbf-476b-4244-b3a9-4a69da5fa17d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:41.242837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:41.243429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.243697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.243974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.244623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:41.244918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:41.246277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:41.257645 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 632/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:41.264136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:41.300947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:41.371919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d81ac9-d40c-4151-8c81-129f840182cd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:41.411276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:41.412092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.412240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.412473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.420125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:41.421601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:41.433669 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:41.434715 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:41.435731 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 639/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:41.440926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:41.502637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:41.548147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ec33-cdca-4d5c-ac5d-eca698a26e5b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:41.582506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:41.583106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.583374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.583636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.584414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:41.584709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:41.586130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c742095-fde6-453d-b6af-0076d66996bc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:41.598762 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 633/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:41.605962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:41.697459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:41.712908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2f1f-aaa4-4574-ac4b-77cff98cb653 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:41.753317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:41.753896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:41.754173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:41.754443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] PATH_INFO: `/v3/projects/08376a0183204ce3a82064609e00c5f4/users/167a92c0eb6d4e609b369e8c359b94cd/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:41.756708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] RBAC: Authorizing `identity:create_grant(project_id=08376a0183204ce3a82064609e00c5f4, user_id=167a92c0eb6d4e609b369e8c359b94cd, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:41.758166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd18c-7aee-4d84-87b4-00dbf0163583 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:41.774911 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 640/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Aug 21 00:59:41 2022] PUT /identity/v3/projects/08376a0183204ce3a82064609e00c5f4/users/167a92c0eb6d4e609b369e8c359b94cd/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:59:43.643025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ecea-a38a-48c2-9712-1a328df2d5d5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:43.644023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ecea-a38a-48c2-9712-1a328df2d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:43.644023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ecea-a38a-48c2-9712-1a328df2d5d5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:43.646088 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 634/1274] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:43.651758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:43.652213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:43.652313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:43.671432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:43.672641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:43.745127 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 641/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:44.015390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8ecea-a38a-48c2-9712-1a328df2d5d5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.130155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8ecea-a38a-48c2-9712-1a328df2d5d5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:44.147314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:44.169389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:44.170011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.170281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.170543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.180881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:59:44.185541 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:44.186677 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:44.187799 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 635/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:44.193163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.280485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:44.301065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328acfa9-6515-4130-a127-7fa7900ba74d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:44.341004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:44.341610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.341884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.342152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.342821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:44.343121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:44.344545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:44.353495 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 642/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:44.359784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.472115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133eb9-c673-4353-88d3-8b0c103a772a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:44.508503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:44.509120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.509391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.509655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.520995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:44.522535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:44.537515 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:44.538711 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:44.540289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:44.540289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:44.540289 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:44.540289 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 636/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:44.545423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.666111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39e992-e22a-4a96-94ff-ac721d77cc09 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:44.700050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:44.700641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.700888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.701176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.701807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:44.702099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:44.703472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:44.714975 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 643/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:44.721088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.751691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:44.821217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6b82a-5001-497e-b820-83b44bb3314d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:44.855459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:44.856097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:44.856386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:44.856630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:44.867928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:44.870307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:59:44.887031 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:44.888195 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:44.889201 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 637/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:59:44.895069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:44.899469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.013166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca505-ef8d-4ef0-a7a5-30240f19db00 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.048501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.049093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.049362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.049626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.050345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:45.050647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.052115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.069017 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 644/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Aug 21 00:59:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:45.075248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:45.175604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.186161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4a4a-c18b-4468-bfc9-938d46713e0e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.221079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.221676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.221922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.222214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.295224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.297074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.390672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.404409 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 638/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Aug 21 00:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:59:45.411479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:45.480448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.529519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52ce8-b054-48c2-a996-30a0e3f6f8da None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.564149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.564760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.565032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.565297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.575555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.577033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:59:45.591634 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:45.592701 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:59:45.593661 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:59:45.593661 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:59:45.593661 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:45.593661 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 645/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 00:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:45.600901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:45.702238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca6f8f-218a-4108-b390-bc60fa370c80 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.736197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.736841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.737049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.737310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.737940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:45.738231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.739586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.751012 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 639/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Aug 21 00:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:45.760803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:45.871310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067d4f-2166-4b1f-a076-fce6fc8adcc1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:45.891164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.914512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:45.915181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:45.915455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:45.915725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:45.922504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:45.924004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:59:45.935478 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:45.936600 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Aug 21 00:59:45.937960 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 646/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Aug 21 00:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:45.942689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:45.997108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:46.050870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c796-644d-4ef5-9f01-e86d5553ed62 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:46.085176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:46.086190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:46.089151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:46.089396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:46.090132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:46.090431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:46.091956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02efa-691e-4ba0-8eee-c73083f939ad None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:46.110337 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 640/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Aug 21 00:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:59:46.117643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:46.231337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da4b7-92da-4bab-b45a-0af23eda6db2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:46.269095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:46.269617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:46.269889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:46.270149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:46.270868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] RBAC: Adding query filter params (role.id=2d0f2944dd3d4b8b84280aa1f49bfd33, scope.project.id=08376a0183204ce3a82064609e00c5f4, user.id=167a92c0eb6d4e609b369e8c359b94cd) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:46.271174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:46.272676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ad6ff-3e2b-44fe-947b-f54ce0094330 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:46.279113 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 647/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Aug 21 00:59:46 2022] GET /identity/v3/role_assignments?user.id=167a92c0eb6d4e609b369e8c359b94cd&scope.project.id=08376a0183204ce3a82064609e00c5f4&role.id=2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:48.204573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db8a4-17c4-4a29-a377-330d8ee67a8d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:48.205184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db8a4-17c4-4a29-a377-330d8ee67a8d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:48.205184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db8a4-17c4-4a29-a377-330d8ee67a8d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:48.206451 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 641/1288] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:48.213273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:48.213989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:48.214158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:48.244197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:48.245387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:48.276851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:48.318489 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 648/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:48.591608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db8a4-17c4-4a29-a377-330d8ee67a8d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:48.703027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db8a4-17c4-4a29-a377-330d8ee67a8d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:48.714677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:48.741729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:48.742360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:48.742618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:48.742880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:48.743453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:48.744857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:48.753684 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:48.754877 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:48.755903 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 642/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:59:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:48.761547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:48.874253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b313d-3c04-4b89-9a93-ec62df12c0e5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:48.924243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:48.925040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:48.925354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:48.925734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:48.926399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:48.926743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:48.928532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae49bda-7773-4c85-bd86-d0da810a8c8f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:48.934852 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 649/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Aug 21 00:59:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:48.941212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:49.050061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001e9a3-e0d3-4986-bdcc-5478dea64fdb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:49.090194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:49.090791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:49.091067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:49.091332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:49.091989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:49.092285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:49.093657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aaa81-b15d-47b5-ac7a-7c8fc9e56140 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:49.098257 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 643/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Aug 21 00:59:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:50.982727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b0bd0-7e0e-475e-89f9-0b3310654089 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.983354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b0bd0-7e0e-475e-89f9-0b3310654089 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.983354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b0bd0-7e0e-475e-89f9-0b3310654089 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.984676 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 650/1293] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:50.990234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b091f-9946-45d4-b493-baed83798f2e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.990770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b091f-9946-45d4-b493-baed83798f2e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.990852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b091f-9946-45d4-b493-baed83798f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:51.011969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bd9b091f-9946-45d4-b493-baed83798f2e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:51.013150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bd9b091f-9946-45d4-b493-baed83798f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:51.047264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:51.086745 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 644/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:51.370412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b0bd0-7e0e-475e-89f9-0b3310654089 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:51.408101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:51.492195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b0bd0-7e0e-475e-89f9-0b3310654089 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:51.532067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:51.532667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:51.532939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:51.533204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:51.533844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:51.535225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c3a1-ab12-47dc-8c9e-77aa3625d9e2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:51.559981 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 651/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Aug 21 00:59:51 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:59:53.478197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2cc5-0fe8-4331-a4ab-54408761592c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.479099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2cc5-0fe8-4331-a4ab-54408761592c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.479099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2cc5-0fe8-4331-a4ab-54408761592c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.481251 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 645/1296] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:53.487468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.487949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.488042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.508155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:53.509348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.606468 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 652/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:53.877286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2cc5-0fe8-4331-a4ab-54408761592c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:53.987473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2cc5-0fe8-4331-a4ab-54408761592c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:54.023188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:54.023807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.024111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.024374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.024967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:54.026328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:54.036048 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:54.037236 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:54.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 646/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:59:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:54.044703 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:54.066327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.148533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588042ea-4485-4473-bff5-10b266f6e45b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:54.183859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:54.184452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.184722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.184988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.185616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:54.185893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:54.187269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.192362 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 653/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Aug 21 00:59:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:54.202227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:54.239474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.321708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afa98-4bb5-4c1d-a4b0-3283d7d3736d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:54.355960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:54.356560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.356828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.357094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.357787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] RBAC: Adding query filter params (interface=public, service_id=4d1e8dac204f43e999665e59e79a3c09, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:54.358086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:54.359436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107819-b192-4c6d-8e53-2443c0cea4a5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.364475 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 647/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Aug 21 00:59:54 2022] GET /identity/v3/endpoints?service_id=4d1e8dac204f43e999665e59e79a3c09&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:54.372923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:54.462855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.484323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af9a5-3566-4ed5-be7c-47afef94f9ad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:54.522133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:54.523106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.523385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.523650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.524286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:54.525664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d298-f572-4000-aa10-1bb8b71361ee None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.532656 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 654/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Aug 21 00:59:54 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:59:56.417219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3f4d-1191-4571-89dd-220de8e74f5f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:56.418075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3f4d-1191-4571-89dd-220de8e74f5f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:56.418075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3f4d-1191-4571-89dd-220de8e74f5f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:56.420234 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 648/1302] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 00:59:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:56.426442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:56.427153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:56.427307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:56.447020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:56.448245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:56.517176 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 655/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:59:56.784316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e3f4d-1191-4571-89dd-220de8e74f5f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:56.909445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:56.918243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e3f4d-1191-4571-89dd-220de8e74f5f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:56.960366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:56.960996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:56.961268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:56.961534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:56.962112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:56.963478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:59:56.972144 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:59:56.973432 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:59:56.974513 dv-cinder-master-3-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 21 00:59:56.975944 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 649/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Aug 21 00:59:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:59:56.979448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:57.063488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:57.087376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288458-b222-4dd3-87d3-e502e1861817 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:57.122194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:57.122791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:57.123062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:57.123333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:57.123992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:59:57.124290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:57.125671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29f3b5-63c6-4a2c-9468-e0dc5130d232 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:57.134376 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 656/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Aug 21 00:59:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:59:57.141078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:57.259065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64290f6-0fa1-4f49-a7ac-33c999a81c2c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:57.296746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:57.297361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:57.297631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:57.297938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:57.298976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:57.301219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64074722-b84d-4948-a603-d0384d1ade11 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:57.329747 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 650/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 00:59:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:00:07.128876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=30 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:07.321856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:02.135368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62439eb-8563-4046-8426-e1d6dfa5f092 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:02.136608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62439eb-8563-4046-8426-e1d6dfa5f092 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:02.137300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62439eb-8563-4046-8426-e1d6dfa5f092 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:02.145007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c21e1-af8c-4d4d-a22d-bf44c6f55d4f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:02.145423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c21e1-af8c-4d4d-a22d-bf44c6f55d4f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:02.145625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c21e1-af8c-4d4d-a22d-bf44c6f55d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:02.148119 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 657/1307] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:02 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:02.234750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-606c21e1-af8c-4d4d-a22d-bf44c6f55d4f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:02.236255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-606c21e1-af8c-4d4d-a22d-bf44c6f55d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:02.384225 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 651/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:02.665289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:02.665539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:02.666007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:02.667547 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 658/1309] 10.222.0.23 () {54 vars in 965 bytes} [Sun Aug 21 01:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:02.673513 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3505d3-af98-426e-888d-256b513872aa None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:02.673766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3505d3-af98-426e-888d-256b513872aa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:02.674235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3505d3-af98-426e-888d-256b513872aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:02.753645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7b3505d3-af98-426e-888d-256b513872aa None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:02.754876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7b3505d3-af98-426e-888d-256b513872aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:02.776321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:02.835733 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 652/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Sun Aug 21 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:02.844463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:02.846322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:02.964138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87dfe-144f-4820-a1a5-8e5f8745d1e2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:03.049008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:03.049631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:03.049901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:03.050165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:03.051983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:03.118747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:03.183296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:03.185040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4a24-1d71-48d3-81dd-49ffdf60e178 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:03.206316 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 659/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:05.392240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:05.392754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:05.392754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:05.394141 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 653/1312] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:05.401364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282d74-e724-457b-99bf-fcaf2208852b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:05.402211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282d74-e724-457b-99bf-fcaf2208852b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:05.402811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282d74-e724-457b-99bf-fcaf2208852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:05.495769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9d282d74-e724-457b-99bf-fcaf2208852b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:05.497139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9d282d74-e724-457b-99bf-fcaf2208852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:05.600209 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 660/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:05.879151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:05.880833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:05.988916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb2ac-9387-4142-8dc6-09a729b5b9c8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:06.063178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:06.065979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:06.066834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:06.067104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:06.067372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:06.069508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:06.183269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:06.184746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66658708-d5a3-485d-bef3-5c1e201fc049 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:06.203345 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 654/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:08.464836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:08.465726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:08.465726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:08.467814 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 661/1315] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:08.475892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579becb2-5e55-49c6-ab25-8a582ad88814 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:08.476345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579becb2-5e55-49c6-ab25-8a582ad88814 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:08.476460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579becb2-5e55-49c6-ab25-8a582ad88814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:08.547695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-579becb2-5e55-49c6-ab25-8a582ad88814 None None] MFA Rules not processed for user `657a7d451d8d4a50a932e747ca49722f`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:08.548851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-579becb2-5e55-49c6-ab25-8a582ad88814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:08.610191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:08.669174 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 655/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:08.966749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:08.969229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:08.985255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:09.101865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff46fa-dfc9-4fde-8389-fa1f87349a5e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:09.187359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:09.188008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:09.188287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:09.188552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:09.190161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:09.256933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:09.310318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:09.311820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4237-9f0d-4d7e-b20f-bc6faf36b167 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:09.331999 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 662/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:11.835984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:11.836578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:11.836578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:11.837875 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 656/1318] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:11.844414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467066-6fbd-4b77-8cc7-376f6597ebde None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:11.845146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467066-6fbd-4b77-8cc7-376f6597ebde None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:11.845304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467066-6fbd-4b77-8cc7-376f6597ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:11.924871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-31467066-6fbd-4b77-8cc7-376f6597ebde None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:11.926098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-31467066-6fbd-4b77-8cc7-376f6597ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:12.034160 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 663/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:12.321109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:12.323462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:12.459684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef2dc1-c042-4f83-9829-6650b39f456c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:12.539211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:12.539766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:12.540050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:12.540320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:12.541939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:12.553957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:12.660382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:12.661829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c464b-367f-4e36-a532-01188d8730c0 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:12.681433 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 657/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:15.314496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9af0f-fa01-4420-9435-f781ecb95756 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.315148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9af0f-fa01-4420-9435-f781ecb95756 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.315148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9af0f-fa01-4420-9435-f781ecb95756 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.316925 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 664/1321] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:15.323615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e31b5-1d9c-45b1-8f84-ef6eb1b44a46 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.324166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e31b5-1d9c-45b1-8f84-ef6eb1b44a46 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.324166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e31b5-1d9c-45b1-8f84-ef6eb1b44a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.391212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e82e31b5-1d9c-45b1-8f84-ef6eb1b44a46 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:15.392429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e82e31b5-1d9c-45b1-8f84-ef6eb1b44a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:15.450421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:15.490217 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 658/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:15.789150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.789430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.789695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.791064 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 665/1323] 10.222.0.23 () {54 vars in 965 bytes} [Sun Aug 21 01:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:15.797254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656809-c4b3-4637-919f-91b20bceec64 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:15.797620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656809-c4b3-4637-919f-91b20bceec64 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:15.797958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656809-c4b3-4637-919f-91b20bceec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:15.879292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-06656809-c4b3-4637-919f-91b20bceec64 None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:15.880671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-06656809-c4b3-4637-919f-91b20bceec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:15.958210 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 659/1324] 10.222.0.23 () {58 vars in 1062 bytes} [Sun Aug 21 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:15.967576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:15.969098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:15.989760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.078135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ee77-dfcd-4566-b50d-299d1a1bb190 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:16.156373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:16.156988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:16.157255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:16.157519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:16.159266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:16.236710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:16.279306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:16.280795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3ffd2-0c30-46a4-ad8f-91920dda97fb service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:16.301645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 666/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:18.478652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:18.479265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:18.479265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:18.480564 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 660/1326] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:18.485888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146adf4-f438-4c07-8e80-2d9530fa2c72 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:18.486334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146adf4-f438-4c07-8e80-2d9530fa2c72 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:18.486443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146adf4-f438-4c07-8e80-2d9530fa2c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:18.556759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f146adf4-f438-4c07-8e80-2d9530fa2c72 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:18.557960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f146adf4-f438-4c07-8e80-2d9530fa2c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:18.669713 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 667/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:18.953795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:18.955418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:19.019696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:19.065993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfbbae-835c-4cd7-add3-6a6a56722049 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:19.146372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:19.147079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:19.147327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:19.147594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:19.149208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:19.260828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:19.263171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:19.265110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987336-cdff-4f5b-9ad1-5a6bbfb26e57 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:19.283957 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 661/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:21.244376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:21.244875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:21.244973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:21.246330 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 668/1329] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:21.251886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004b8e-4847-4794-99f9-dafc3a685cc6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:21.252296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004b8e-4847-4794-99f9-dafc3a685cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:21.252437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004b8e-4847-4794-99f9-dafc3a685cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:21.324242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bd004b8e-4847-4794-99f9-dafc3a685cc6 None None] MFA Rules not processed for user `657a7d451d8d4a50a932e747ca49722f`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:21.325368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bd004b8e-4847-4794-99f9-dafc3a685cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:21.431057 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 662/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:21.711718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:21.713454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:21.750999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:21.837447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132585b-b27a-46ae-ba37-1d5668fdff31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:21.920564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:21.921212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:21.921491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:21.921759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:21.923414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:22.013396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:22.050618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:22.052205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89481d-5647-4243-904f-0dadb0ec62c8 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:22.074052 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 669/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:24.414675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:24.415254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:24.415254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:24.416596 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 663/1332] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:24.422097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972a3f-b570-4d6f-9b93-2dd821d22849 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:24.422492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972a3f-b570-4d6f-9b93-2dd821d22849 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:24.422632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972a3f-b570-4d6f-9b93-2dd821d22849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:24.493727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b7972a3f-b570-4d6f-9b93-2dd821d22849 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:24.494944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b7972a3f-b570-4d6f-9b93-2dd821d22849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:24.608887 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 670/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:24.901434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:24.902994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:24.982116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:25.018116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bb3f1-bc5a-481a-9417-d5d65908c21c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:25.102880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:25.103492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:25.103733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:25.104056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:25.105673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:25.244128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:25.245455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75eefa-0bd4-4f8c-8ebf-3b2951eec92a service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:25.257490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:25.265955 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 664/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:27.256450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:27.257290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:27.257464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:27.259591 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 671/1335] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:27.265138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7224cc-0451-4da1-979c-92d03e9c539b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:27.266843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7224cc-0451-4da1-979c-92d03e9c539b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:27.267123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7224cc-0451-4da1-979c-92d03e9c539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:27.345133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ca7224cc-0451-4da1-979c-92d03e9c539b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:27.346361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ca7224cc-0451-4da1-979c-92d03e9c539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:27.456155 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 665/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:27.755147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:27.757996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:27.806427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:27.882159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f4965-82ac-4f79-b561-35c404f3aef3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:27.966335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:27.966932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:27.967201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:27.967462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:27.969087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:28.064951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:28.092893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:28.094357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd8c8-15e4-4370-bab6-1a0392c2d547 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:28.113066 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 672/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:30.531130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:30.531707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:30.531707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:30.533013 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 666/1338] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:30.538910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297252-9bdd-43ac-9f69-0f89fa4d5762 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:30.539347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297252-9bdd-43ac-9f69-0f89fa4d5762 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:30.539347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297252-9bdd-43ac-9f69-0f89fa4d5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:30.626865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f3297252-9bdd-43ac-9f69-0f89fa4d5762 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:30.628135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f3297252-9bdd-43ac-9f69-0f89fa4d5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:30.740209 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 673/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:31.019799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:31.022173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:31.098189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:31.126255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba73f42-54b4-4a5c-bd9f-85d5d68bda0a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:31.203698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:31.204331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:31.204601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:31.204860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:31.206661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:31.330612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:31.332074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257fb5f-c56d-4c7c-a6dc-f3bf0ee0a918 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:31.350168 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 667/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:35.305788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:35.306266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:35.306266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:35.311425 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 674/1341] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:35.313194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac71cb-f29b-44d0-8374-78f811013a14 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:35.313567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac71cb-f29b-44d0-8374-78f811013a14 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:35.313737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac71cb-f29b-44d0-8374-78f811013a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:35.320317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:35.382558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-38ac71cb-f29b-44d0-8374-78f811013a14 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:35.383767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-38ac71cb-f29b-44d0-8374-78f811013a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:35.486061 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 668/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:35.770733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:35.772546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:35.821682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:35.883566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f464d-9a85-4eea-aa6b-e8703a46b619 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:35.966471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:35.967089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:35.967361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:35.967627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:35.969330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:36.073199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:36.091231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:36.092788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be19d7d-b720-481e-afa0-979854f19c81 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:36.111964 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 675/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:38.671215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:38.671685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:38.671804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:38.673197 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 669/1344] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:38.678976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999603-aefd-40c0-98f3-76208ffb6b60 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:38.679432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999603-aefd-40c0-98f3-76208ffb6b60 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:38.679528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999603-aefd-40c0-98f3-76208ffb6b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:38.749066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ef999603-aefd-40c0-98f3-76208ffb6b60 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:38.750258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ef999603-aefd-40c0-98f3-76208ffb6b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:38.850013 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 676/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:39.129745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:39.131551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:39.225816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:39.243941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e642b9-2551-47e7-b278-607bb87824cd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:39.323514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:39.324180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:39.324459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:39.324727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:39.326435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:39.439480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:39.440982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9af5-c5e7-48c3-98d5-72d30614cb94 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:39.460202 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 670/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:43.348360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:43.348903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:43.348903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:43.350394 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 677/1347] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:43.355938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf101aa-4fd2-4ddb-91e4-010550f35d6b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:43.356410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf101aa-4fd2-4ddb-91e4-010550f35d6b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:43.356563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf101aa-4fd2-4ddb-91e4-010550f35d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:43.372539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:43.429961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9bf101aa-4fd2-4ddb-91e4-010550f35d6b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:43.431183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9bf101aa-4fd2-4ddb-91e4-010550f35d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:43.559897 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 671/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:43.831951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:43.833961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:43.901108 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:43.954187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8df5-192e-4873-b7f2-9ba710d8d8f9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:44.035052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:44.035806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:44.036149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:44.036476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:44.039330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:44.160192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:44.165199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:44.166773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e656c5-495c-467e-b539-bc0df9e32353 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:44.192945 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 678/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:49.111113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be7af-84d7-4f9a-9d70-66855257bf37 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:49.112162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be7af-84d7-4f9a-9d70-66855257bf37 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:49.112647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be7af-84d7-4f9a-9d70-66855257bf37 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:49.114289 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 672/1350] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:49.120443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e84a-3037-4b5f-a6db-dda38f35858e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:49.121416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e84a-3037-4b5f-a6db-dda38f35858e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:49.121863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e84a-3037-4b5f-a6db-dda38f35858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:49.214760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d2a1e84a-3037-4b5f-a6db-dda38f35858e None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:49.216521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d2a1e84a-3037-4b5f-a6db-dda38f35858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:49.394100 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 679/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:53.553623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=59 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:53.766225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04e4c-c1eb-41a7-897f-5df5791873fe None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:53.766568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04e4c-c1eb-41a7-897f-5df5791873fe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:53.766835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04e4c-c1eb-41a7-897f-5df5791873fe None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:53.768409 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 673/1352] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:53.773695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae867b4-22a8-4e90-bc70-be61c9065013 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:53.774178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae867b4-22a8-4e90-bc70-be61c9065013 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:53.774308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae867b4-22a8-4e90-bc70-be61c9065013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:53.837795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:53.863379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cae867b4-22a8-4e90-bc70-be61c9065013 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:53.864598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cae867b4-22a8-4e90-bc70-be61c9065013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:53.977520 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 680/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:55.091577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76401d-8b20-4396-bd9b-be993a35ee92 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:55.092156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76401d-8b20-4396-bd9b-be993a35ee92 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:55.092156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76401d-8b20-4396-bd9b-be993a35ee92 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:55.093526 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 674/1354] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:55.098592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b049-5f34-4e91-9944-ce33b150fc86 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:55.099077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b049-5f34-4e91-9944-ce33b150fc86 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:55.099197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b049-5f34-4e91-9944-ce33b150fc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:55.178246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e9d1b049-5f34-4e91-9944-ce33b150fc86 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:55.179423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e9d1b049-5f34-4e91-9944-ce33b150fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:55.220849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:55.290122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 681/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:58.678276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbf41-ca73-4271-98cb-18fcfb4b4ea2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:58.678860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbf41-ca73-4271-98cb-18fcfb4b4ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:58.678860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbf41-ca73-4271-98cb-18fcfb4b4ea2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:58.680165 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 675/1356] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:58.685671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b150e-f57e-4998-aa39-43b65e0859ed None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:58.686114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b150e-f57e-4998-aa39-43b65e0859ed None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:58.686224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b150e-f57e-4998-aa39-43b65e0859ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:58.762248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e64b150e-f57e-4998-aa39-43b65e0859ed None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:58.763481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e64b150e-f57e-4998-aa39-43b65e0859ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:58.895147 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 682/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:59.205752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:59.206250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:59.206699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:59.208897 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 676/1358] 10.222.0.23 () {54 vars in 962 bytes} [Sun Aug 21 01:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:59.217313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9f21-dfc7-4b81-ad5b-2ea432c54960 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:59.218773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9f21-dfc7-4b81-ad5b-2ea432c54960 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:59.219366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9f21-dfc7-4b81-ad5b-2ea432c54960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:59.244636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:59.316017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-51eb9f21-dfc7-4b81-ad5b-2ea432c54960 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:59.317222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-51eb9f21-dfc7-4b81-ad5b-2ea432c54960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:59.438363 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 683/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Aug 21 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:59.446522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:59.447997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:59.594363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc846-2374-4885-8b7d-cdc09d95a859 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:59.680609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:59.723288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:59.723941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:59.724215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:59.724738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:59.726371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:59.818318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:59.819965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e64f1d-bb8d-4717-b2ec-a51c6ffc6ce6 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:59.838816 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 677/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:01.977558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:01.978174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:01.978174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:01.979617 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 684/1361] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:01.985028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7807-2ebf-446e-ba6f-365db1a8de1b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:01.985602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7807-2ebf-446e-ba6f-365db1a8de1b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:01.985602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7807-2ebf-446e-ba6f-365db1a8de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:02.056524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1cae7807-2ebf-446e-ba6f-365db1a8de1b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:02.057808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1cae7807-2ebf-446e-ba6f-365db1a8de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:02.101187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:02.164790 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 678/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:02.455396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:02.458135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:02.535600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:02.631434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807faac-28fc-43d3-9f36-46d14e053955 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:02.750934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:02.751546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:02.751843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:02.752126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:02.753743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:02.778394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:02.874886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:02.876867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999957-8ab6-4316-b7d2-c38811393d10 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:02.897292 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 685/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:05.093859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402f7a-4989-4bc1-888d-412f0dad6ae6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:05.094402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402f7a-4989-4bc1-888d-412f0dad6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:05.094592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402f7a-4989-4bc1-888d-412f0dad6ae6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:05.096318 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 679/1364] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:05.102115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef57fe-a55d-4716-ae25-d0552dd56835 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:05.102569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef57fe-a55d-4716-ae25-d0552dd56835 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:05.102719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef57fe-a55d-4716-ae25-d0552dd56835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:05.182734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b2ef57fe-a55d-4716-ae25-d0552dd56835 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:05.183981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b2ef57fe-a55d-4716-ae25-d0552dd56835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:05.298716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:05.301894 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 686/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:05.586554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:05.586767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:05.587038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:05.588566 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 680/1366] 10.222.0.23 () {54 vars in 962 bytes} [Sun Aug 21 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:05.594321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b2d0-4c99-4752-8810-76c0ad00d608 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:05.594878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b2d0-4c99-4752-8810-76c0ad00d608 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:05.595216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b2d0-4c99-4752-8810-76c0ad00d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:05.680381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1d74b2d0-4c99-4752-8810-76c0ad00d608 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:05.681706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1d74b2d0-4c99-4752-8810-76c0ad00d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:05.803472 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 687/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Aug 21 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:05.811689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:05.813270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:05.970861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992dec4-7624-4536-a804-a24b4a3ef819 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:05.991989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:06.091198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:06.091719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:06.092023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:06.092284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:06.093907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:06.189209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:06.191014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a63ef3-3de8-4839-94c5-f44e92ce546a service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:06.209991 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 681/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:06.909064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036c3d-f886-471d-9c5b-cc504c95188e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:06.909623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036c3d-f886-471d-9c5b-cc504c95188e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:06.909623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036c3d-f886-471d-9c5b-cc504c95188e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:06.911290 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 688/1369] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:06.917168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9492ff-7847-4382-985a-5103c388c010 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:06.917455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9492ff-7847-4382-985a-5103c388c010 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:06.917728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9492ff-7847-4382-985a-5103c388c010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:06.951286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:06.991109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ba9492ff-7847-4382-985a-5103c388c010 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:06.992349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ba9492ff-7847-4382-985a-5103c388c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:07.093507 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 682/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:07.706750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:07.707158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:07.707551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:07.711779 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 689/1371] 10.222.0.23 () {54 vars in 964 bytes} [Sun Aug 21 01:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:07.715560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52718ed-905c-41dc-9fa8-b75aee684937 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:07.716069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52718ed-905c-41dc-9fa8-b75aee684937 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:07.716316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52718ed-905c-41dc-9fa8-b75aee684937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:07.796903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f52718ed-905c-41dc-9fa8-b75aee684937 None None] MFA Rules not processed for user `3bc1abc667b4456d89f42912085211e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:07.798202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f52718ed-905c-41dc-9fa8-b75aee684937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:07.846508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:07.878489 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 683/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Aug 21 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:07.886297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:07.888310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:07.941898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:07.999682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e620fd-e685-4079-a7b8-f90fd4221528 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:08.089649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:08.090272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:08.090548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:08.090853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:08.092617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:08.212164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b65c-a6ac-4aed-9919-da54b1093333 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:08.212164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b65c-a6ac-4aed-9919-da54b1093333 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:08.212792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b65c-a6ac-4aed-9919-da54b1093333 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:08.214165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:08.214270 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 684/1373] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:08.219295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156cbc-7626-4ccc-899d-904c49052135 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:08.219621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156cbc-7626-4ccc-899d-904c49052135 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:08.219858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156cbc-7626-4ccc-899d-904c49052135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:08.233688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:08.235351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:08.255300 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 690/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:08.304978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fd156cbc-7626-4ccc-899d-904c49052135 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:08.306091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fd156cbc-7626-4ccc-899d-904c49052135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:08.407527 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 685/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:08.690109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:08.691315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:08.790992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a69dc-97ab-4f80-992d-2db6e962cba1 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:08.900314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:08.913143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:08.913774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:08.914054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:08.914325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:08.915988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:09.010797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:09.012422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7429588-a51b-40d2-90f2-c2ea5d461077 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:09.031015 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 691/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:10.980435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:10.980989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:10.980989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:10.982174 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 686/1377] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:10.987840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82678-7f28-4d6c-aacf-0415616d5cfb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:10.988245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82678-7f28-4d6c-aacf-0415616d5cfb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:10.988414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82678-7f28-4d6c-aacf-0415616d5cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:11.060723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7be82678-7f28-4d6c-aacf-0415616d5cfb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:11.061919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7be82678-7f28-4d6c-aacf-0415616d5cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:11.138744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:11.171669 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 692/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:11.457353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:11.458934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:11.512290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:11.619084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e3ee-7431-4be6-bc56-98cef291a4de None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:11.773843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:11.774726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:11.775098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:11.775467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:11.777271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:11.794073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:11.894082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:11.896034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483077a5-4c16-44bf-91ed-98b1f947493d service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:11.915440 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 687/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:13.873525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:13.874567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:13.875033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:13.876747 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 693/1380] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:13.883008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fc7f-7bf9-433e-8480-d4262de070cb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:13.883555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fc7f-7bf9-433e-8480-d4262de070cb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:13.883758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fc7f-7bf9-433e-8480-d4262de070cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:13.953344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-30f0fc7f-7bf9-433e-8480-d4262de070cb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:13.954748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-30f0fc7f-7bf9-433e-8480-d4262de070cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:14.048378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:14.062569 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 688/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:14.361441 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:14.363141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:14.524815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5d45-89a2-4276-829d-858ee1b682b6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:14.578357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:14.664295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:14.664902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:14.665180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:14.665451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:14.667076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:14.762484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:14.764332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c04e-db59-42d6-94dd-40aa8660c2f5 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:14.787889 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 694/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:17.000364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:17.001058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:17.001058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:17.002886 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 689/1383] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:02:17.009523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f91d-df48-4293-a1d2-52d338856c4a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:17.010207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f91d-df48-4293-a1d2-52d338856c4a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:17.010207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f91d-df48-4293-a1d2-52d338856c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:17.089547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9699f91d-df48-4293-a1d2-52d338856c4a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:17.091207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9699f91d-df48-4293-a1d2-52d338856c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:17.094044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:17.216476 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 695/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:17.517707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:17.519714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:17.708476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c775d-cc4f-42f5-ab10-29281ebc125f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:17.782046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:17.838999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:17.839669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:17.839992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:17.840248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:17.842018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:17.942886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:17.944684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b639055-ab0f-424b-8a65-f29fe0e326c7 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:17.965976 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 690/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:20.172278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:20.172914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:20.172914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:20.174257 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 696/1386] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:20.180369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98f92-6f36-4c38-b905-43e7cbf28219 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:20.181114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98f92-6f36-4c38-b905-43e7cbf28219 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:20.181114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98f92-6f36-4c38-b905-43e7cbf28219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:20.256136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-21e98f92-6f36-4c38-b905-43e7cbf28219 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:20.257837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21e98f92-6f36-4c38-b905-43e7cbf28219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:20.292736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:20.389940 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 691/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:20.679895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:20.681587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:20.822776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:20.845595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c469dd-56ee-4e0c-8e00-fe371a296413 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:20.976141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f93f-b989-476a-a430-e089a659335c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:20.976765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f93f-b989-476a-a430-e089a659335c service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:20.977047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f93f-b989-476a-a430-e089a659335c service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:20.977308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f93f-b989-476a-a430-e089a659335c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:20.979426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3919f93f-b989-476a-a430-e089a659335c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:21.084860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f93f-b989-476a-a430-e089a659335c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:21.086550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f93f-b989-476a-a430-e089a659335c service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:21.091845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:21.108615 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 697/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:23.064839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960f2b-0bc2-4a77-aa81-85300e69a258 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.065478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960f2b-0bc2-4a77-aa81-85300e69a258 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.065478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4960f2b-0bc2-4a77-aa81-85300e69a258 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.066998 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 692/1389] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:23.072762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e37e-ffda-43d5-b26b-5e22df0d3a4d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.073212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e37e-ffda-43d5-b26b-5e22df0d3a4d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.073329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e37e-ffda-43d5-b26b-5e22df0d3a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.140854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a465e37e-ffda-43d5-b26b-5e22df0d3a4d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:23.142056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a465e37e-ffda-43d5-b26b-5e22df0d3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:23.246322 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 698/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:23.396836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.397218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.397493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.398897 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 693/1391] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:23.404462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf445b9-746f-428c-ac89-31ed20fae3af None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.404744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf445b9-746f-428c-ac89-31ed20fae3af None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.405008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf445b9-746f-428c-ac89-31ed20fae3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.475748 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-edf445b9-746f-428c-ac89-31ed20fae3af None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:23.476967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-edf445b9-746f-428c-ac89-31ed20fae3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:23.498162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:23.538118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:23.539999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:23.579941 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 699/1392] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:23.696841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dbb37-5c38-42e7-a08d-f9f37387bd58 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:23.706721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:23.815418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:23.816047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.816325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.816658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.818279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:23.882424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1f9d-ab4a-4670-b424-c5b21d646d48 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.882699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1f9d-ab4a-4670-b424-c5b21d646d48 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.882972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1f9d-ab4a-4670-b424-c5b21d646d48 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.884363 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 700/1393] 10.222.0.23 () {54 vars in 967 bytes} [Sun Aug 21 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:02:23.889005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033036b-981f-49a3-9989-7d10b2a26937 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:23.889277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033036b-981f-49a3-9989-7d10b2a26937 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:23.889546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033036b-981f-49a3-9989-7d10b2a26937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:23.910909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:23.912888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:23.931324 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 694/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:02:23.969749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1033036b-981f-49a3-9989-7d10b2a26937 None None] MFA Rules not processed for user `6b5bfa3fddfc4d1cb865331a2f5e4d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:23.970902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1033036b-981f-49a3-9989-7d10b2a26937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:24.062757 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 701/1395] 10.222.0.23 () {58 vars in 1064 bytes} [Sun Aug 21 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:24.073047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:24.074290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:24.093578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:24.164123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d028644-1be2-4883-a125-d020004669f2 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:24.239527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:24.240082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:24.240360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:24.240609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:24.242210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:24.338730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:24.358025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:24.359470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bcd44-4fc4-4987-b537-61e0b4884f6f service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:24.377704 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 695/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:25.140987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3268-7266-41a8-b40f-2f9b49f777ba None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.141493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3268-7266-41a8-b40f-2f9b49f777ba None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.141585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3268-7266-41a8-b40f-2f9b49f777ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:25.162667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:25.213838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c3dd3268-7266-41a8-b40f-2f9b49f777ba None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:25.215044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c3dd3268-7266-41a8-b40f-2f9b49f777ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:25.306078 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 702/1397] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:25.353988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.354534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.354534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:25.355921 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 696/1398] 10.222.0.23 () {54 vars in 943 bytes} [Sun Aug 21 01:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:25.362517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bc0c6-1ddf-49e1-ac6a-f64a3bdea693 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.362882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bc0c6-1ddf-49e1-ac6a-f64a3bdea693 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.363246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bc0c6-1ddf-49e1-ac6a-f64a3bdea693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:25.441866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e66bc0c6-1ddf-49e1-ac6a-f64a3bdea693 None None] MFA Rules not processed for user `9842b5bcc876492e9e765c86a3ba3138`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:25.443088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e66bc0c6-1ddf-49e1-ac6a-f64a3bdea693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:25.492869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:25.552694 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 703/1399] 10.222.0.23 () {58 vars in 1040 bytes} [Sun Aug 21 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:25.562259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:25.563826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:25.722760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7165-1873-4d13-b0a7-20dd4c5bc0af None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:25.784801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:25.830769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:25.831385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.831659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.831953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:25.833785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:25.919251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:25.920927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa9d32-5ee3-495e-af24-268c25c626d7 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:25.929618 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 697/1400] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:02:25.981749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.982152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.982492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:25.984100 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 704/1401] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:25.989825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f20-ef47-4c7d-bfaa-4f00f8194cdd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:25.990194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f20-ef47-4c7d-bfaa-4f00f8194cdd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:25.990534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f20-ef47-4c7d-bfaa-4f00f8194cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:26.071060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1c733f20-ef47-4c7d-bfaa-4f00f8194cdd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:26.072287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c733f20-ef47-4c7d-bfaa-4f00f8194cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:26.123727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:26.178598 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 698/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:26.477210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:26.479408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:26.642308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a8a3-4280-4c5b-9fc8-08a025fd80f0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:26.665205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:26.776570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:26.777216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:26.777494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:26.777758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:26.779381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:26.877451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:26.879456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91282ce-0642-46d3-b561-9be865eed3c2 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:26.900851 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 705/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:28.852049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:28.852664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:28.852664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:28.854107 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 699/1404] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:28.859240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4e5-408c-4d1d-b893-f2367a5fa3fa None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:28.862473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4e5-408c-4d1d-b893-f2367a5fa3fa None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:28.862754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4e5-408c-4d1d-b893-f2367a5fa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:28.898731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:28.941847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-db65e4e5-408c-4d1d-b893-f2367a5fa3fa None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:28.943390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-db65e4e5-408c-4d1d-b893-f2367a5fa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:29.066654 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 706/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:29.369293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:29.369293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:29.577998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb57194-4491-4d4b-b7bc-35edd70e0ae7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:29.619298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:29.719351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:29.720120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:29.720452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:29.720630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:29.722257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:29.837341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:29.839010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119f05-2e47-4ec1-90f3-23055aeaec74 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:29.865201 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 700/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:31.839519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:31.840157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:31.840157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:31.841568 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 707/1407] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:02:31.846900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663962-7143-42d7-bf6f-e51a30845762 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:31.847315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663962-7143-42d7-bf6f-e51a30845762 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:31.847439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663962-7143-42d7-bf6f-e51a30845762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:31.905119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:31.930494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e2663962-7143-42d7-bf6f-e51a30845762 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:31.931978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e2663962-7143-42d7-bf6f-e51a30845762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:32.035178 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 701/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:32.349373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:32.350949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:32.472560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:32.527856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864dfd-d7d8-4435-90f6-b095c0278011 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:32.654189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:32.654799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:32.655070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:32.655331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:32.656974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:32.729862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:32.756429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:32.758283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024ac3-ad59-47a6-b239-59325dbb3288 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:32.779491 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 708/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:02:42.033372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=49 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:42.776741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=16 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:48.185441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412b80-9651-4ff4-a6e0-9e634facf951 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:48.186060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412b80-9651-4ff4-a6e0-9e634facf951 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:48.186060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412b80-9651-4ff4-a6e0-9e634facf951 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:48.187325 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 702/1410] 10.222.0.23 () {54 vars in 918 bytes} [Sun Aug 21 01:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:48.192844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d801-8a98-4cb6-bc33-1172475517f3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:48.193420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d801-8a98-4cb6-bc33-1172475517f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:48.193420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d801-8a98-4cb6-bc33-1172475517f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:48.281877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e290d801-8a98-4cb6-bc33-1172475517f3 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:48.283079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e290d801-8a98-4cb6-bc33-1172475517f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:48.406130 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 709/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Aug 21 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:48.421667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede1ab-947e-4688-9079-91b61a4483ac None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:48.421952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede1ab-947e-4688-9079-91b61a4483ac None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:48.422218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede1ab-947e-4688-9079-91b61a4483ac None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:48.423563 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 703/1412] 10.222.0.23 () {54 vars in 918 bytes} [Sun Aug 21 01:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:48.428470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21bad-df65-48da-8302-95b4aca0f866 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:48.428752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21bad-df65-48da-8302-95b4aca0f866 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:48.429016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21bad-df65-48da-8302-95b4aca0f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:48.510404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:48.514062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fbc21bad-df65-48da-8302-95b4aca0f866 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:48.515960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fbc21bad-df65-48da-8302-95b4aca0f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:48.644171 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 710/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Aug 21 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:51.049557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:51.050170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:51.050170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:51.051422 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:51.057824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624c9c-598e-401d-a554-eaacaa70fee8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:51.058558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624c9c-598e-401d-a554-eaacaa70fee8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:51.058654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624c9c-598e-401d-a554-eaacaa70fee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:51.132406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0c624c9c-598e-401d-a554-eaacaa70fee8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:51.133647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0c624c9c-598e-401d-a554-eaacaa70fee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:51.195204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:51.240287 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:51.532248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:51.534146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:51.706985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733784c-5e71-4714-8ddc-14c0cb4243c6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:51.785042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:51.830370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:51.831206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:51.831567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:51.831972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:51.834352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:51.937454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:51.939045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aed17-e681-4ebc-b59c-79465990297b service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:51.958348 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 705/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:52.869355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:52.869944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:52.869944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:52.871282 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:52.877645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb68f-a452-4c4e-bf19-5d6a194404c4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:52.878410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb68f-a452-4c4e-bf19-5d6a194404c4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:52.878627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb68f-a452-4c4e-bf19-5d6a194404c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:52.965967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9b3fb68f-a452-4c4e-bf19-5d6a194404c4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:52.967182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9b3fb68f-a452-4c4e-bf19-5d6a194404c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:52.994812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:53.070991 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:53.223973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:53.225558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:53.383878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de15f-916e-4d05-b4d9-4dae8bbf7514 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:53.427008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:53.514275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:53.514787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:53.515057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:53.515319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:53.516950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:53.633044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:53.635397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2364d4-b72a-4285-bb6d-fc7725996b0b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:53.658526 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 713/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:54.547389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:54.547968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:54.547968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:54.549230 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:54.554356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c844-a6dc-40db-ad12-a0428118d490 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:54.554807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c844-a6dc-40db-ad12-a0428118d490 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:54.554911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c844-a6dc-40db-ad12-a0428118d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:54.613576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:54.638902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc84c844-a6dc-40db-ad12-a0428118d490 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:54.640140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc84c844-a6dc-40db-ad12-a0428118d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:54.760261 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:54.920389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:54.922336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:55.088864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4fef-c5bb-4eaf-bd00-635068ca93bc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:55.106733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:55.212508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:55.213020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:55.213274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:55.213538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:55.215136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:55.313004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:55.314639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4be0f6-42b5-43a3-9d5f-7c7404ae720c service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:55.332548 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 708/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:56.207061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:56.208014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:56.208014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:56.210058 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:56.215591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea2ee-dbcf-4943-b470-ba6f5b754006 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:56.216222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea2ee-dbcf-4943-b470-ba6f5b754006 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:56.216222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea2ee-dbcf-4943-b470-ba6f5b754006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:56.237319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:56.298479 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d35ea2ee-dbcf-4943-b470-ba6f5b754006 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:56.299706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d35ea2ee-dbcf-4943-b470-ba6f5b754006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:56.404306 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:02:56.554710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:56.557227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:56.689003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:56.727233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928225f-5b7a-4fab-983b-ebc03bb8a264 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:56.852433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:56.852941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:56.853212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:56.853472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:56.855092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:56.938655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:56.953778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:56.955433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba632b3-cd11-42ba-a4c0-d20a894f8486 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:56.975250 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 716/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:57.834330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:57.834810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:57.834917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:57.836285 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:57.844685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cab5-cf58-473b-82a1-3d4fc44f0369 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:57.845131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cab5-cf58-473b-82a1-3d4fc44f0369 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:57.845226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cab5-cf58-473b-82a1-3d4fc44f0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:57.925960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b993cab5-cf58-473b-82a1-3d4fc44f0369 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:57.927163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b993cab5-cf58-473b-82a1-3d4fc44f0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:58.038885 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:58.197147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:58.199591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:58.289237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:58.356288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539aa3-03d1-4333-b2a6-b452e50e4575 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:02:58.482487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:02:58.483316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:58.483585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:58.483881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:58.485483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:58.543124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:58.590404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:02:58.592093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f4b59-207c-4a66-a039-459d7be7cfec service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:02:58.612453 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 711/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:02:59.442405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:59.443260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:59.443260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:59.444873 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:02:59.451036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa662a-48b3-47f0-9554-a8de66644c2d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:02:59.451811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa662a-48b3-47f0-9554-a8de66644c2d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:02:59.451909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa662a-48b3-47f0-9554-a8de66644c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:02:59.539175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-73fa662a-48b3-47f0-9554-a8de66644c2d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:02:59.540324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-73fa662a-48b3-47f0-9554-a8de66644c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:59.643214 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:02:59.796909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:02:59.798339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:02:59.864423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:59.968272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df51e-68ce-4896-a1dc-80f79be97d75 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:00.095287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:00.095973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:00.096304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:00.096665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:00.099245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:00.106640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:00.196514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:00.198290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095377b-b76b-4fe2-9375-c83f0fbcc6a7 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:00.220583 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 719/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:01.024799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:01.025361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:01.025361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:01.026616 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:01.032645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c379c-fbf4-4878-98ea-3c31fd993b9e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:01.033125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c379c-fbf4-4878-98ea-3c31fd993b9e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:01.033223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c379c-fbf4-4878-98ea-3c31fd993b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:01.113017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9a1c379c-fbf4-4878-98ea-3c31fd993b9e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:01.114209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9a1c379c-fbf4-4878-98ea-3c31fd993b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:01.187357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:01.217341 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:01.367406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:01.369152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:01.387680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:01.519925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1f8af-a063-4e52-a8b6-94e671b3028a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:01.612861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:01.649304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:01.650122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:01.650512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:01.650889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:01.653527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:01.752361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:01.753954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158fe5-790c-4d43-b308-2feb217fc961 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:01.772851 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 714/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:02.606406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:02.606970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:02.606970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:02.608229 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:03:02.614318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce9e1-f32c-4cf4-a204-f1409055e70b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:02.615140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce9e1-f32c-4cf4-a204-f1409055e70b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:02.615248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce9e1-f32c-4cf4-a204-f1409055e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:02.697710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0f2ce9e1-f32c-4cf4-a204-f1409055e70b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:02.699540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0f2ce9e1-f32c-4cf4-a204-f1409055e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:02.748440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:02.810757 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:02.962586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:02.964169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:03.125978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495f54-8df0-4a9c-8dbe-1e706303aac2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:03.183442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:03.259831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:03.260366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:03.260645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:03.260910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:03.262555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:03.361778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:03.363398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537046-ae9e-4e03-93e6-be12ae379060 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:03.381916 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 722/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:04.190405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:04.191008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:04.191008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:04.192354 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:04.198633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949f29-2f44-4d64-a195-a96052ec9f5d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:04.199415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949f29-2f44-4d64-a195-a96052ec9f5d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:04.199615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949f29-2f44-4d64-a195-a96052ec9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:04.290846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d7949f29-2f44-4d64-a195-a96052ec9f5d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:04.291764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d7949f29-2f44-4d64-a195-a96052ec9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:04.294073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:04.420744 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:04.572544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:04.574117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:04.738309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba31a-76e6-4fb7-87d5-d95d2aba20c1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:04.768426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:04.865761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:04.866369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:04.866639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:04.866900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:04.868529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:04.967823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:04.969431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91fdd9-3d2b-4efe-a539-4aa5325adec8 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:04.990551 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 717/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:06.777474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:06.778082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:06.778082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:06.779376 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:06.785116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc65-bf3b-4fc4-b2e9-546fe029be21 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:06.785576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc65-bf3b-4fc4-b2e9-546fe029be21 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:06.785675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc65-bf3b-4fc4-b2e9-546fe029be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:06.830427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:06.860481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cf9fbc65-bf3b-4fc4-b2e9-546fe029be21 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:06.861709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cf9fbc65-bf3b-4fc4-b2e9-546fe029be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:06.966831 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:07.251799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:07.254453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:07.389641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee00d6-73fe-4b88-9eae-f3f76318dfd3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:07.425150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:07.468842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:07.469448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:07.469725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:07.469990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:07.471607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:07.591238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:07.592672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e208d-aadf-4eda-98d4-a2fff9351732 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:07.612582 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 725/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:09.683409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:09.684024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:09.684024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:09.685346 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:09.691651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8ec6-ba18-4b93-ba2e-1146780a53bf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:09.692438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8ec6-ba18-4b93-ba2e-1146780a53bf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:09.692567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8ec6-ba18-4b93-ba2e-1146780a53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:09.773327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-15dd8ec6-ba18-4b93-ba2e-1146780a53bf None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:09.774551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-15dd8ec6-ba18-4b93-ba2e-1146780a53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:09.789018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:09.888442 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:10.176731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:10.178298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:10.286699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff943358-9c3e-4f54-9eb1-20f490a653b8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:10.300745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:10.367293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:10.368011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:10.368289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:10.368549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:10.370169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:10.490028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:10.491606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4534-5962-48df-949b-1939c3239fc5 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:10.510660 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 720/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:03:12.779311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.780288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.780288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.782396 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:12.791553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e599a-fc28-4d39-aad4-77e75ca569f4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.792287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e599a-fc28-4d39-aad4-77e75ca569f4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.792402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e599a-fc28-4d39-aad4-77e75ca569f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.860661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:12.889544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9d6e599a-fc28-4d39-aad4-77e75ca569f4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:12.890905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9d6e599a-fc28-4d39-aad4-77e75ca569f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:13.001695 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:13.304448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:13.306028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:13.421164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcebd6-869e-4136-81f1-ca47257c5bcb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:13.466741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:13.507099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:13.507712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:13.507998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:13.508269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:13.509903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:13.634884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:13.636379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6de0af-4dbc-4b90-b573-957566aff328 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:13.654415 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 728/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:15.791339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:15.791980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:15.791980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:15.793854 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:15.800418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12235e-cb27-4de8-8755-9c92b05b449b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:15.800893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12235e-cb27-4de8-8755-9c92b05b449b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:15.801011 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12235e-cb27-4de8-8755-9c92b05b449b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:15.880572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc12235e-cb27-4de8-8755-9c92b05b449b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:15.881994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc12235e-cb27-4de8-8755-9c92b05b449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:15.907194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:15.991958 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:16.279655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:16.282152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:16.393520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6404-5876-41ab-8b39-9dec44b58122 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:16.416543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:16.473122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:16.473709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:16.473983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:16.474252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:16.475943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:16.587853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:16.589188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b238-429a-4b3b-8cec-a0faf1d44384 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:16.608415 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 723/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:18.647485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:18.648366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:18.648586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:18.651026 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:18.656931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73e0a-85b9-4d18-9051-d280242458b2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:18.657411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73e0a-85b9-4d18-9051-d280242458b2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:18.657510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73e0a-85b9-4d18-9051-d280242458b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:18.724584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:18.729357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8ec73e0a-85b9-4d18-9051-d280242458b2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:18.732799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8ec73e0a-85b9-4d18-9051-d280242458b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:18.840681 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:19.127668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:19.129272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:19.236451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8d16c-866e-48ef-b5b0-941316c93c29 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:19.290263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:19.316374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:19.316976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:19.317285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:19.317546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:19.319169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:19.435694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:19.437179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed093d-835f-4e84-9428-27ef5d9230b3 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:19.455209 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 731/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:21.424705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:21.425333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:21.425333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:21.426706 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:21.435393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f1fac-9f74-45a5-ac13-86bfb6de9fa4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:21.436354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f1fac-9f74-45a5-ac13-86bfb6de9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:21.436630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f1fac-9f74-45a5-ac13-86bfb6de9fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:21.513163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e1f1fac-9f74-45a5-ac13-86bfb6de9fa4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:21.514358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e1f1fac-9f74-45a5-ac13-86bfb6de9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:21.546018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:21.616385 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:21.910171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:21.911723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:22.022075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f2be-b16f-4945-9062-28d93e4fd366 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:22.055079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:22.113154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:22.113860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:22.114196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:22.114505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:22.117158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:22.236206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:22.237662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be0cfe-95dc-4a0e-a527-607e8b01acb3 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:22.256068 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 726/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:03:24.273948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:24.274562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:24.274562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:24.275897 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:24.281742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432818-7476-4d16-8879-5825e99cbff8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:24.282174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432818-7476-4d16-8879-5825e99cbff8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:24.282267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432818-7476-4d16-8879-5825e99cbff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:24.351948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6b432818-7476-4d16-8879-5825e99cbff8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:24.353210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6b432818-7476-4d16-8879-5825e99cbff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:24.361969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:24.464213 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:24.749447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:24.751979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:24.886850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f4c88-629e-4eeb-ac01-eb2a84066c79 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:24.948319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:24.970706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:24.971346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:24.971618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:24.971914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:24.973534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:25.093058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:25.094474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a22fa4-c741-43f5-97c9-b1686d172720 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:25.113609 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 734/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:27.081774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954190-b300-451a-992f-096b80e430d9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:27.082362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954190-b300-451a-992f-096b80e430d9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:27.082362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954190-b300-451a-992f-096b80e430d9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:27.083662 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:27.090893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e400b-1408-48be-9a10-3120f42b6675 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:27.092373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e400b-1408-48be-9a10-3120f42b6675 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:27.092373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e400b-1408-48be-9a10-3120f42b6675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:27.176026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3c3e400b-1408-48be-9a10-3120f42b6675 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:27.177249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3c3e400b-1408-48be-9a10-3120f42b6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:27.219774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:27.290219 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:27.577298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3954190-b300-451a-992f-096b80e430d9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:27.579703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e3954190-b300-451a-992f-096b80e430d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:27.695084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3954190-b300-451a-992f-096b80e430d9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:27.858621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:27.898254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:27.898912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:27.899172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:27.899425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:27.901048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:28.014071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:28.015508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37845e55-23a8-410e-abcd-70fa8fb01872 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:28.034334 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 729/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:29.978421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:29.979348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:29.979348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:29.982121 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:29.987986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d8b1-9d9c-4e56-9b94-2321aef507c5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:29.988419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d8b1-9d9c-4e56-9b94-2321aef507c5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:29.988514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d8b1-9d9c-4e56-9b94-2321aef507c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:30.059670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2005d8b1-9d9c-4e56-9b94-2321aef507c5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:30.060916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2005d8b1-9d9c-4e56-9b94-2321aef507c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:30.080201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:30.188897 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:30.479070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:30.480813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:30.604043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9163c-a0bb-4bdd-a287-cd125f002dc6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:30.680690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:30.687444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:30.688087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:30.688354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:30.688610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:30.690195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:30.835091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:30.836881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb084f57-8ac6-408a-93ba-9e58cd4c75df service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:30.858265 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 737/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:32.843796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:32.844754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:32.844754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:32.846890 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:32.852547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22d7-fd81-41f7-ac01-279408e97d5f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:32.853047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22d7-fd81-41f7-ac01-279408e97d5f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:32.853047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22d7-fd81-41f7-ac01-279408e97d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:32.929564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5aef22d7-fd81-41f7-ac01-279408e97d5f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:32.931229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5aef22d7-fd81-41f7-ac01-279408e97d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:32.981883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:33.033399 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:33.317503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:33.319115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:33.430900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ee1b-0076-43d5-bdb2-31f6225ad693 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:33.483432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:33.513947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:33.514552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:33.514817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:33.515072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:33.516685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:33.634021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:33.635314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2d4a3-34e2-4cf8-b283-e80a6b0713f5 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:33.654195 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 732/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:43.031475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=22 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:43.651670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=66 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:53.246746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b383c-249f-4a8e-879e-f1474fd4acca None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:53.247816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b383c-249f-4a8e-879e-f1474fd4acca None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:53.247816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b383c-249f-4a8e-879e-f1474fd4acca None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:53.249815 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 739/1471] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:03:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:53.260318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd082b-c231-4ac5-b555-2fe8a892b4e5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:53.261089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd082b-c231-4ac5-b555-2fe8a892b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:53.261268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd082b-c231-4ac5-b555-2fe8a892b4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:53.338956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-85bd082b-c231-4ac5-b555-2fe8a892b4e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:53.340204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-85bd082b-c231-4ac5-b555-2fe8a892b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:53.451054 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 733/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:53.752752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:53.753228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:53.753677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:53.755779 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 740/1473] 10.222.0.23 () {54 vars in 967 bytes} [Sun Aug 21 01:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:53.761641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f071c53-b5a4-4e1c-9997-3354c4c277e3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:53.761922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f071c53-b5a4-4e1c-9997-3354c4c277e3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:53.762169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f071c53-b5a4-4e1c-9997-3354c4c277e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:53.839682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6f071c53-b5a4-4e1c-9997-3354c4c277e3 None None] MFA Rules not processed for user `6b5bfa3fddfc4d1cb865331a2f5e4d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:53.840937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6f071c53-b5a4-4e1c-9997-3354c4c277e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:53.863062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:53.921818 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 734/1474] 10.222.0.23 () {58 vars in 1064 bytes} [Sun Aug 21 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:53.930017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:53.931544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:54.049550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4c88-0260-4a7b-8041-8887ed605913 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:54.131556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:54.132188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:54.132464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:54.132733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:54.134901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:54.194050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:54.252297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:54.253755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf846e0-8802-4e5d-a426-a62533cb41ba service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:54.275229 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 741/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:56.459007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:56.460007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:56.460007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:56.462285 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 735/1476] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:56.468769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bcd2-31b0-42d0-b3e6-9c7176e0f97a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:56.469233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bcd2-31b0-42d0-b3e6-9c7176e0f97a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:56.469365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bcd2-31b0-42d0-b3e6-9c7176e0f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:56.548201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-16d0bcd2-31b0-42d0-b3e6-9c7176e0f97a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:56.549339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-16d0bcd2-31b0-42d0-b3e6-9c7176e0f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:56.657310 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 742/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:56.934188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:56.936726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:57.086049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46dee-ba24-4cd5-a5c2-75296586c1fd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:57.146739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:57.195487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:57.196137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:57.196410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:57.196674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:57.197317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:57.199057 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:57.199057 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:03:57.199057 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:03:57.200245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5466-e105-4d93-a86e-394c28200117 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:57.219447 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 736/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Aug 21 01:03:56 2022] GET /identity/v3/projects => generated 2553 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:03:59.163871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:59.164632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:59.164632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:59.165939 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 743/1479] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:03:59.171469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170532-d21b-49c8-b0c8-005b78344366 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:59.171960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170532-d21b-49c8-b0c8-005b78344366 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:59.172055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170532-d21b-49c8-b0c8-005b78344366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:59.240366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-92170532-d21b-49c8-b0c8-005b78344366 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:59.241526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-92170532-d21b-49c8-b0c8-005b78344366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:59.348599 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 737/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:59.652997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:59.655596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:59.669587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:59.819383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7a6a-616e-4b09-8fd5-841daf751165 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:59.916445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:59.949802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:59.950406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:59.950679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:59.950944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:59.952573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:00.059334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:00.060989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6294c67-0668-4b41-a36d-72071d48146b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:00.081220 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 744/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:02.210301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:02.211112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:02.211112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:02.212552 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 738/1482] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:02.218063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e667-26f4-4614-b889-cd05546f80a2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:02.218532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e667-26f4-4614-b889-cd05546f80a2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:02.218645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e667-26f4-4614-b889-cd05546f80a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:02.296521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b350e667-26f4-4614-b889-cd05546f80a2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:02.297735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b350e667-26f4-4614-b889-cd05546f80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:02.349165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:02.410784 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 745/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:02.731601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:02.734053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:02.763674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:02.846588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ebfb8-41ba-4e8b-925d-7ac09602f9dd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:02.926032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:02.926682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:02.926906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:02.927153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:02.928780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:03.003597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:03.039314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:03.041184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aafc91-eea2-4dd3-b20a-4d9cfff19527 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:03.059702 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 739/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:05.029973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:05.030854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:05.030854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:05.032945 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 746/1485] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:05.042798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f71f-086d-46d5-9752-8ad182d16339 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:05.043247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f71f-086d-46d5-9752-8ad182d16339 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:05.043358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f71f-086d-46d5-9752-8ad182d16339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:05.129290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-81a7f71f-086d-46d5-9752-8ad182d16339 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:05.130491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-81a7f71f-086d-46d5-9752-8ad182d16339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:05.240119 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 740/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:05.524604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:05.526254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:05.649626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0132f-7620-4ccb-bd6a-e2ca48c81510 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:05.739409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:05.741743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:05.743030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:05.743570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:05.744074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:05.745906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:05.867001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:05.868606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eefabb-9845-4588-9c83-c30a4f9b28c2 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:05.887052 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 747/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:07.909897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:07.910483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:07.910483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:07.912096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 741/1488] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:07.918729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c763d-6d55-4c2e-8d68-f253f87df0cb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:07.919217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c763d-6d55-4c2e-8d68-f253f87df0cb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:07.919316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c763d-6d55-4c2e-8d68-f253f87df0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:08.000259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5d8c763d-6d55-4c2e-8d68-f253f87df0cb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:08.001483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5d8c763d-6d55-4c2e-8d68-f253f87df0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:08.066015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:08.111286 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 748/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:08.401668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:08.403220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:08.451275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:08.536307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5221f-9a14-44e0-acfb-9ba666a2c25d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:08.622044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:08.622648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:08.622913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:08.623175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:08.624806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:08.721059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:08.753983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:08.755409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b96c3-c6c6-4d6d-8847-414a7ac336c6 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:08.773956 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 742/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:10.884046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554952e2-0211-4667-88ec-e28667b2009c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:10.884886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554952e2-0211-4667-88ec-e28667b2009c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:10.885269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554952e2-0211-4667-88ec-e28667b2009c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:10.887569 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 749/1491] 10.222.0.23 () {54 vars in 927 bytes} [Sun Aug 21 01:04:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:10.893470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc89-2439-4000-b866-a1ba4e3c326c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:10.893942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc89-2439-4000-b866-a1ba4e3c326c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:10.894047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc89-2439-4000-b866-a1ba4e3c326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:10.976546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-616afc89-2439-4000-b866-a1ba4e3c326c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:10.977797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-616afc89-2439-4000-b866-a1ba4e3c326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:11.105822 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 743/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Aug 21 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:04:11.408836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554952e2-0211-4667-88ec-e28667b2009c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:11.411310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-554952e2-0211-4667-88ec-e28667b2009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:11.534688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554952e2-0211-4667-88ec-e28667b2009c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:11.618411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:11.618768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:11.619014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:11.619380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:11.621912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:11.635696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:11.739449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:11.740932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c507d4e-e3e3-4f4a-b782-909035cb0546 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:11.759974 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 750/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:21.103452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=82 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:21.756973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=50 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:23.923706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:23.924260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:23.924260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:24.014574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:24.015770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:24.119092 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 744/1494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:24.128040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:24.128570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:24.128570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:24.208476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:24.209618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:24.320366 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 751/1495] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:24.326059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:24.327286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:24.339344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45518a62-26ee-4c56-a650-5c5c27591bb4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:24.411323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:24.453563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:24.454181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:24.454457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:24.454723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:24.455400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:05:24.455707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:24.456754 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:24.456754 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:05:24.456754 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:05:24.457671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:24.470221 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 745/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:05:24.479047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:24.488671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcc489-152a-4fa8-a381-0959dcb413a7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:24.554925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:24.589950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:24.590564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:24.590841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:24.591112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:24.591758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:24.593589 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:24.593589 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:05:24.593589 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:05:24.594785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:24.673894 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 752/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:05:24 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:05:24.678164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:24.679694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:24.715799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d914-df6d-4b7d-a104-e8fde76bf69c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:24.827103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:24.827627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:24.827938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:24.828207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:24.828837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:24.829847 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:24.829847 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:05:24.829847 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:05:24.831084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:24.879176 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 746/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:05:24 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:05:24.885898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:24.888277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:24.956562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d05198-7ea6-410d-8ef5-fcbd3ef988c9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:25.052399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:25.067627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:25.068274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.068548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.068816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.069496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:25.070526 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:25.070526 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:05:25.070526 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:05:25.071416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:25.084777 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 753/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:05:25.089354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:25.090962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:25.103186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f1a1-3848-44d7-a97f-5ed96759a6a2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:25.130784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:25.206889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:25.207492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.207776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.208050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.208694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:25.209701 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:25.209701 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:05:25.209701 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:05:25.210577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662b41-cb17-45e0-a5bf-d224e6269506 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:25.223018 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 747/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:05:25.227470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:25.229400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:25.264825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291dd5b-4bec-4159-9dda-b5ddf84b250a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:25.373662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:25.374232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.374495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.374761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] PATH_INFO: `/v3/projects/d28898db55ab4f5cb419ebb70e6af000/users/b5b96beed61442c086b3bf4aae7f5874/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.398378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28898db55ab4f5cb419ebb70e6af000, user_id=b5b96beed61442c086b3bf4aae7f5874, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:25.399785 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:25.399785 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:05:25.399785 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:05:25.401965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56909c-dfd8-4d88-ae28-6deef8fbcce0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:25.431073 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 754/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:05:25 2022] PUT /identity/v3/projects/d28898db55ab4f5cb419ebb70e6af000/users/b5b96beed61442c086b3bf4aae7f5874/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:05:25.443696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7530f8-96d7-4b03-9543-e82c3e55bed6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.444059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7530f8-96d7-4b03-9543-e82c3e55bed6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.444296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7530f8-96d7-4b03-9543-e82c3e55bed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.501750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-aa7530f8-96d7-4b03-9543-e82c3e55bed6 None None] MFA Rules not processed for user `b5b96beed61442c086b3bf4aae7f5874`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:25.502978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa7530f8-96d7-4b03-9543-e82c3e55bed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:25.581418 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 748/1502] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:25.594830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.595110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.595382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.596804 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 755/1503] 10.222.0.23 () {54 vars in 964 bytes} [Sun Aug 21 01:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:25.601582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3ce3-d176-4f35-b31b-34cd09276043 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.601853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3ce3-d176-4f35-b31b-34cd09276043 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.602123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3ce3-d176-4f35-b31b-34cd09276043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.638258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:25.686350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8dac3ce3-d176-4f35-b31b-34cd09276043 None None] MFA Rules not processed for user `3bc1abc667b4456d89f42912085211e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:25.687573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8dac3ce3-d176-4f35-b31b-34cd09276043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:25.768873 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 749/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Aug 21 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:05:25.777394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:25.778919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:25.839310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:25.906923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4d7e-c054-43d8-a31a-c08c324156ce None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:25.986267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:25.986873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:25.987142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:25.987405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:25.989031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:26.108022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:26.109480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:26.112925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:26.128479 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 756/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:26.173982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76da59-103b-4c3c-98e8-311d28af0965 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:26.174433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76da59-103b-4c3c-98e8-311d28af0965 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:26.174543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76da59-103b-4c3c-98e8-311d28af0965 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:26.175878 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 750/1506] 10.222.0.23 () {52 vars in 830 bytes} [Sun Aug 21 01:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:05:26.179772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:26.180996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:26.282137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4cf24-ffa2-4434-8f46-3c3534737476 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:26.390067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:26.390679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:26.390951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:26.391218 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] PATH_INFO: `/v3/users/b5b96beed61442c086b3bf4aae7f5874` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:26.404610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b96beed61442c086b3bf4aae7f5874)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:26.405601 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:26.405601 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:05:26.405601 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:05:26.406831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:26.417751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:26.486425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b96beed61442c086b3bf4aae7f5874'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:26.486866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b96beed61442c086b3bf4aae7f5874'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:26.499654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b96beed61442c086b3bf4aae7f5874'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:26.514173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b96beed61442c086b3bf4aae7f5874'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:26.542961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b96beed61442c086b3bf4aae7f5874'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:26.553284 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 757/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:05:26 2022] DELETE /identity/v3/users/b5b96beed61442c086b3bf4aae7f5874 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:05:26.559471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:26.559755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:26.560054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:26.619294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:05:26.620610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:26.700850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:26.714738 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 751/1508] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:05:26.727315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:26.728598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:26.834379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887dfb8-291a-4d26-8b4f-34604905e574 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:27.022445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:27.045991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:27.046607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:27.046882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:27.047149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:27.048834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:27.181601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:27.183634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5275-57ee-4e4d-a9e3-2a0f4199090c service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:27.203071 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 758/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:27.570536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:05:27.571849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:05:27.583666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca819d-0c74-406a-94d3-dccef20669d4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:05:27.686554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:05:27.687163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:05:27.687443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:05:27.687733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] PATH_INFO: `/v3/projects/d28898db55ab4f5cb419ebb70e6af000` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:05:27.697908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28898db55ab4f5cb419ebb70e6af000)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:05:27.699292 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:27.699292 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:05:27.699292 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:05:27.700531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:05:27.770247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28898db55ab4f5cb419ebb70e6af000', 'request_id': 'req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:27.776402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28898db55ab4f5cb419ebb70e6af000', 'request_id': 'req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:27.788446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28898db55ab4f5cb419ebb70e6af000', 'request_id': 'req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:27.820973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] The token cache is being invalidate because project d28898db55ab4f5cb419ebb70e6af000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:05:27.821167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:27.821735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-106f6c6b-7c8b-4209-80e9-6ff420a8ffdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:05:27.823259 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 752/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:05:27 2022] DELETE /identity/v3/projects/d28898db55ab4f5cb419ebb70e6af000 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:05:37.200694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=62 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:37.818465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:00.775732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.776620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.776794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.779081 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:07:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:00.785114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece285bd-70d4-475c-87ce-631fa3048b0f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:00.785584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece285bd-70d4-475c-87ce-631fa3048b0f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:00.785698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece285bd-70d4-475c-87ce-631fa3048b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:00.885192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ece285bd-70d4-475c-87ce-631fa3048b0f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:00.886981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ece285bd-70d4-475c-87ce-631fa3048b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:01.001292 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:01.154268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:01.158092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:01.293953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011cc0b-c2c4-4df1-87f6-ad7dbe2220c6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:01.302092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:01.303734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:01.303734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:01.304188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:01.317908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:01.319944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed067e-88b6-4dfb-878e-5385cf7e0363 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:01.329873 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 760/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:02.169843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44582ff-4fa7-4f43-a57e-6493ec162835 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.170450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44582ff-4fa7-4f43-a57e-6493ec162835 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.170450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44582ff-4fa7-4f43-a57e-6493ec162835 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.171708 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:02.179350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affab46-7ae1-44d8-b2b9-8927f8ab04ab None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.179815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affab46-7ae1-44d8-b2b9-8927f8ab04ab None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.180012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affab46-7ae1-44d8-b2b9-8927f8ab04ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.202092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3affab46-7ae1-44d8-b2b9-8927f8ab04ab None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:02.203292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3affab46-7ae1-44d8-b2b9-8927f8ab04ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.211908 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:02.275913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2f7eb-adc8-4883-b40b-7e3a542aa4ab None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.276201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2f7eb-adc8-4883-b40b-7e3a542aa4ab None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.276474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2f7eb-adc8-4883-b40b-7e3a542aa4ab None None] PATH_INFO: `/v3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.277903 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 755/1516] 10.222.0.64 () {54 vars in 925 bytes} [Sun Aug 21 01:07:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:07:02.284966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d635-5f8a-4556-9790-dc3f7f8c185a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.285249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d635-5f8a-4556-9790-dc3f7f8c185a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.285518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d635-5f8a-4556-9790-dc3f7f8c185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.350187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3b44d635-5f8a-4556-9790-dc3f7f8c185a None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:02.351379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3b44d635-5f8a-4556-9790-dc3f7f8c185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:02.367857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2f7eb-adc8-4883-b40b-7e3a542aa4ab None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:02.382736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2f7eb-adc8-4883-b40b-7e3a542aa4ab None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:02.389378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:02.390013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:02.390289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:02.390554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:02.400126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:02.401756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675dfcf-5451-41b5-9edb-d8ef6633f724 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:02.406007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:02.415228 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 756/1517] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:02.427723 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 762/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Sun Aug 21 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:11.345600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9620f-4c84-4f86-b2d2-25efbf44d8f4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.346183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9620f-4c84-4f86-b2d2-25efbf44d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.346183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9620f-4c84-4f86-b2d2-25efbf44d8f4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.348403 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 757/1519] 10.222.0.23 () {54 vars in 961 bytes} [Sun Aug 21 01:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:11.353631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246456e-fe69-46a2-8cc6-9cabfef1f273 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.354091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246456e-fe69-46a2-8cc6-9cabfef1f273 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.354220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246456e-fe69-46a2-8cc6-9cabfef1f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.374814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d246456e-fe69-46a2-8cc6-9cabfef1f273 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:11.376018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d246456e-fe69-46a2-8cc6-9cabfef1f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:11.385250 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 763/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Aug 21 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:11.393595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9620f-4c84-4f86-b2d2-25efbf44d8f4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:11.414570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9620f-4c84-4f86-b2d2-25efbf44d8f4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:11.420288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:11.420893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:11.421169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:11.421445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:11.430099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:11.431688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165265-1904-4439-bded-aebe1ac40804 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:11.441394 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 758/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:13.688539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e131d4-4a21-4edd-9c05-d449d0e90705 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.689466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e131d4-4a21-4edd-9c05-d449d0e90705 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.689466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e131d4-4a21-4edd-9c05-d449d0e90705 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.691581 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:07:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:13.699728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8af86-2922-4292-8bd7-5de10dfff17c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.700534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8af86-2922-4292-8bd7-5de10dfff17c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.700716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8af86-2922-4292-8bd7-5de10dfff17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.727848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a2f8af86-2922-4292-8bd7-5de10dfff17c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:13.729042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a2f8af86-2922-4292-8bd7-5de10dfff17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:13.738435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:13.895967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e131d4-4a21-4edd-9c05-d449d0e90705 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:13.922154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e131d4-4a21-4edd-9c05-d449d0e90705 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:13.932545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:13.933333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:13.933670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:13.934025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:13.943353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:13.944935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d064-cc08-453f-9193-f7f165290542 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:13.955122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 765/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:14.795912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083794f9-69d4-4eba-bc34-493f36376c1b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.796527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083794f9-69d4-4eba-bc34-493f36376c1b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.796527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083794f9-69d4-4eba-bc34-493f36376c1b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.797796 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:14.803700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b34d6-3197-4ad0-ad76-630665e1b2f1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.804491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b34d6-3197-4ad0-ad76-630665e1b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.804657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b34d6-3197-4ad0-ad76-630665e1b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.832685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9f3b34d6-3197-4ad0-ad76-630665e1b2f1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:14.833898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9f3b34d6-3197-4ad0-ad76-630665e1b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.843633 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:14.996244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083794f9-69d4-4eba-bc34-493f36376c1b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:15.013515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083794f9-69d4-4eba-bc34-493f36376c1b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:15.019762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:15.020379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:15.020653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:15.020916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:15.029511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:15.031118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e89b-dc0f-44ce-9d1d-a16d1822dcce service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:15.041528 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 761/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:18.788687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.789332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.789332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.790579 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:18.797854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b628-e97f-4c74-b57c-96f01f441f16 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:18.798328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b628-e97f-4c74-b57c-96f01f441f16 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:18.798439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b628-e97f-4c74-b57c-96f01f441f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:18.828538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ad67b628-e97f-4c74-b57c-96f01f441f16 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:18.829716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ad67b628-e97f-4c74-b57c-96f01f441f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:18.838132 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:19.122969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:19.125048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:19.211073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3bd6-83c9-48cd-95ab-9196b53c0c96 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:19.215260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:19.216022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:19.216706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:19.216706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:19.226671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:19.228164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0bae-5978-45d2-838b-517b1d7cb783 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:19.237957 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 768/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:21.150225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580aaf-27ce-41d5-a534-bd5821e74d5c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.150848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580aaf-27ce-41d5-a534-bd5821e74d5c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.150848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580aaf-27ce-41d5-a534-bd5821e74d5c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.152107 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:21.158584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8357-1f0b-41c7-b2c2-f85396e1ff40 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.159063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8357-1f0b-41c7-b2c2-f85396e1ff40 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.159063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8357-1f0b-41c7-b2c2-f85396e1ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.179503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e95b8357-1f0b-41c7-b2c2-f85396e1ff40 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:21.180701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e95b8357-1f0b-41c7-b2c2-f85396e1ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:21.189525 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:21.478517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99580aaf-27ce-41d5-a534-bd5821e74d5c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:21.494824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99580aaf-27ce-41d5-a534-bd5821e74d5c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:21.501076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:21.501873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:21.502147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:21.502381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:21.512033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:21.513900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fc1e5-41e3-4f2f-90d7-42cf3c5d1927 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:21.523429 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 764/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:25.009595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.010236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.010236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.011528 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:25.017124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a61-cf13-43e4-ac83-57a500d72828 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.017670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a61-cf13-43e4-ac83-57a500d72828 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.017670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a61-cf13-43e4-ac83-57a500d72828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.027769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:25.043703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-759c2a61-cf13-43e4-ac83-57a500d72828 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:25.045100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-759c2a61-cf13-43e4-ac83-57a500d72828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.055475 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:25.609195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:25.611591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:25.704379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae692354-1831-49d5-9b38-386b526b0576 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:25.708385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:25.708993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:25.709253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:25.709544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:25.718810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:25.720307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d74fc-4221-44df-80b7-80a697dd8de8 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:25.730161 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 771/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:27.655033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.655651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.655651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.656975 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:27.663713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14f036-4030-47c0-bcb2-5c5bc05926ce None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:27.664506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14f036-4030-47c0-bcb2-5c5bc05926ce None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:27.664659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14f036-4030-47c0-bcb2-5c5bc05926ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:27.686321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0c14f036-4030-47c0-bcb2-5c5bc05926ce None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:27.687510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0c14f036-4030-47c0-bcb2-5c5bc05926ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:27.696138 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:28.242612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:28.244817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:28.264263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9f95-ae7c-43da-912d-f669b8f959b0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:28.268350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:28.268949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:28.269217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:28.269481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:28.279009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:28.280481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c242-870e-4193-add4-2aae0148a7fe service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:28.290574 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 767/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:37.681493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:38.286166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:54.383497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.384180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.384180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.417917 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.419119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.436385 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 773/1540] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:54.445833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.446896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.447387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.485137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.488151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.497547 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 768/1541] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:54.502264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.517130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13febffa-c05d-4b16-b970-68bd031dc978 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.523635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.524623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.525165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.525777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.526657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:54.527179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.528475 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:54.528475 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:08:54.528475 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:08:54.529969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.547573 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 774/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:54.559437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.571641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26afca-71ae-43e4-b779-5421857a5404 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.580757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.581409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.581689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.581957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.582610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.583721 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:54.583721 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:08:54.583721 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:08:54.584974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.654888 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 769/1543] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:54.663594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.678976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfdcd-4e1a-4d83-8b0f-7d10eb98f031 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.757899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.758986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.759502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.760200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.762434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.763099 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:54.763099 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:08:54.763099 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:08:54.764830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6491757-697e-48da-b358-02ef8b57bfb4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.798472 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 775/1544] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:54.802202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.817785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d03fa-c174-4196-92a7-281e700defc0 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.828304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.829227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.829227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.829516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.830102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.833440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd281e6-477f-483b-ab69-518502ae6a06 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.834269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd281e6-477f-483b-ab69-518502ae6a06 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.834801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd281e6-477f-483b-ab69-518502ae6a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.835806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.851801 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 770/1545] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:54.851801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.871332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f0ba-7d62-45f2-aadd-a262d1b6467c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.872527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1dd281e6-477f-483b-ab69-518502ae6a06 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.874159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1dd281e6-477f-483b-ab69-518502ae6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.890892 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 776/1546] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:54.896876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.897529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.897804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.898210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.898874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:54.900804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:54.902513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886e14-7ceb-46b1-a2c0-2de3d0d0c1f8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.903020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886e14-7ceb-46b1-a2c0-2de3d0d0c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.904187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1886e14-7ceb-46b1-a2c0-2de3d0d0c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.920855 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 771/1547] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:54.926745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:54.943956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c1886e14-7ceb-46b1-a2c0-2de3d0d0c1f8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.946226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c1886e14-7ceb-46b1-a2c0-2de3d0d0c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.950406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaabfb-7895-4c09-b477-a3253fbc2317 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:54.963512 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 777/1548] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:08:54.965204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.965709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.966193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.972909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:54.972909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.972909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.974955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] PATH_INFO: `/v3/projects/419393058b0c49298d8addbf8b58eefc/users/7bc45cf3b94b46729e07483f996d1f5e/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.018370 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.020338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.026981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419393058b0c49298d8addbf8b58eefc, user_id=7bc45cf3b94b46729e07483f996d1f5e, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.028139 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:55.028139 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:08:55.028139 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:08:55.030264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b916e56-30f2-4bef-a66a-f681e914c4d8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.047905 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 778/1549] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.049495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.070435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 772/1550] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:54 2022] PUT /identity/v3/projects/419393058b0c49298d8addbf8b58eefc/users/7bc45cf3b94b46729e07483f996d1f5e/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:08:55.071869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82941-a2a3-4576-93b2-39eaf8f5208b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.072158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82941-a2a3-4576-93b2-39eaf8f5208b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.072429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82941-a2a3-4576-93b2-39eaf8f5208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.073769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec460-7c3e-4d27-8a58-069e9f5f12ae None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.095811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5bf82941-a2a3-4576-93b2-39eaf8f5208b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.097408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5bf82941-a2a3-4576-93b2-39eaf8f5208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.149876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.150508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.150778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.151059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.151718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.152067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.153775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf7f21-dafe-4037-bf72-3f169d27a70d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.168936 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 773/1551] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.169988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8bc1-d69e-4991-ba9e-cf98c6ef5feb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.170267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8bc1-d69e-4991-ba9e-cf98c6ef5feb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.170531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8bc1-d69e-4991-ba9e-cf98c6ef5feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.172580 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 779/1552] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.174160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523dd8-646f-49de-9c1f-160de6d1219f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.174691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523dd8-646f-49de-9c1f-160de6d1219f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.175168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523dd8-646f-49de-9c1f-160de6d1219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.197420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1efe8bc1-d69e-4991-ba9e-cf98c6ef5feb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.206156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-66523dd8-646f-49de-9c1f-160de6d1219f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.206338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1efe8bc1-d69e-4991-ba9e-cf98c6ef5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.206466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-66523dd8-646f-49de-9c1f-160de6d1219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.213198 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 780/1554] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.213329 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 774/1554] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.214310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa861c5d-2049-4b44-8d51-8f2765603f9a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.214592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa861c5d-2049-4b44-8d51-8f2765603f9a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.214853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa861c5d-2049-4b44-8d51-8f2765603f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.218217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173acb-e930-4240-acce-0c85cdf44b99 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.218655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173acb-e930-4240-acce-0c85cdf44b99 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.218930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173acb-e930-4240-acce-0c85cdf44b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.234378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fa861c5d-2049-4b44-8d51-8f2765603f9a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.235566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fa861c5d-2049-4b44-8d51-8f2765603f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.244140 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 781/1555] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.245473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464f89-0a4b-4bb2-ae15-781d7412e16b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.245749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464f89-0a4b-4bb2-ae15-781d7412e16b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.245943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-15173acb-e930-4240-acce-0c85cdf44b99 None None] MFA Rules not processed for user `7bc45cf3b94b46729e07483f996d1f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.246140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464f89-0a4b-4bb2-ae15-781d7412e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.247114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-15173acb-e930-4240-acce-0c85cdf44b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.265227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-29464f89-0a4b-4bb2-ae15-781d7412e16b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.266398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-29464f89-0a4b-4bb2-ae15-781d7412e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.274344 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 782/1556] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.275488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.275790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.276059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.299798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.300908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.308717 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 783/1557] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.309478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.312682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:55.317803 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 775/1558] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.319258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431626d-ae68-4e98-b450-4b14826aa7e1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.320618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.321041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.321323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.324601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.325213 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.325487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.325751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.326373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.328588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ade03c-e3b9-4066-8a69-1a8e3badf23c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.341841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.343045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.344406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:55.353540 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 776/1559] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.354416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.358604 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 784/1560] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.359929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e071-574a-436a-8914-1d781b7f2b15 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.360138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e071-574a-436a-8914-1d781b7f2b15 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.360404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e071-574a-436a-8914-1d781b7f2b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.371504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a850d87-aefc-43a5-8187-94455af9fb64 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.380438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2779e071-574a-436a-8914-1d781b7f2b15 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.381707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2779e071-574a-436a-8914-1d781b7f2b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.428775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.429398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.429670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.429970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.430616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.430915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.432572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8708-8c87-4f3c-b744-ac2d6174fb7a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.440178 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 785/1561] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.441433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.441712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.441986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.445930 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 777/1562] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.447892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.448178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.448451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.462258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.463453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.470336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.475902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.476069 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 786/1563] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.476069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.485714 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 778/1564] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.485901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497b3cf-a2b5-4ded-845e-98d93b6db551 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.486027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.489271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.489971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.490434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.490732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.491385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.491683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.493337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c705395-58e7-422f-a7fa-2a3998d222c2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.506112 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 787/1565] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.507315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.507593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.507891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.526884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:55.528118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:55.536400 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 788/1566] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:55.537064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.544475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b4e6c-8cfe-456d-9586-a7401c3822f7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.546086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7b93-586f-48b5-9e79-56a2cebbaeb2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.548211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.548830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.549107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.549375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.550522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.551041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.551313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.551572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.552215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.554648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.577795 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 789/1567] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.578624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.590433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29a490-4dc7-462d-b2f1-08541250540c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.594866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.595465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.595764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.596020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.596664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.596958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.598684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.606651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.608183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.611470 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 790/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.613133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.617964 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 779/1569] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:55.619085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.623155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc64fbc-0fa3-4648-a61d-8d6aef8cde34 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.627615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.628237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.628511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.628776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.629382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.629507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f0d24-88ff-4717-9864-a0965491220d service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.631814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.634871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.635474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.635913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.636184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.636832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.637129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.638713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.651147 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 780/1570] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.652200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.664361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01851-38cf-414d-9d1c-4b2e1ed992ed admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.673334 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 791/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.674183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.686791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:55.727101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.727720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.728090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.728295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.728927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.729222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.730831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.744032 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 781/1572] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.748920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.751896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12c927-068a-420b-b2da-4433f996324a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.758308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.759303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.759824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.760299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.761219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34300-ccd2-4a5f-9dae-d7c692e4fbf8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.761525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.763901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.766659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.767267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.767543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.767845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.768493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:08:55.768791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.770368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.785068 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 782/1573] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:08:55.786504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.799872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107a3e-6317-4c0a-be1f-da9fb302a45c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.804394 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 792/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.804394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.807124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:55.871312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.871960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.872233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.872497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.873139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.875055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.879507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4564f1-6afc-4a6f-9ca3-0302b039fc7b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.886149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.886772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.887046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.887318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.888314 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 783/1575] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:55.888573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.889476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.890670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.901748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207d14-3e89-401f-bbd9-fb2ad27de279 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:55.906619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:55.907492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:55.907692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:55.908046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:55.908614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:55.911610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:55.931916 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 793/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.932912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:55.945749 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 784/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:55.945749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.003583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6062-3cf9-4684-9181-12d1139e68ee admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.019882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5d293-026a-490e-bfbb-5171abee5668 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.026024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.026977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.027237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.027501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.028188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.030820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.061441 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 785/1578] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.062385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.066951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.080141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.081046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.081518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.081811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.082505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.085659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.109861 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 794/1579] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:55 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.111008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.124140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae439c4-f286-4283-9a64-55a676a2b322 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.150828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.159304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36652eb5-08f0-4d73-a869-837f0831d86b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.168609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.169255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.169532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.172054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.172968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.175200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.194707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.195360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.195634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.195933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.196688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.198839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.225333 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 786/1580] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.226069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.230967 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 795/1581] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.232068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.244978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720d2a-af6c-4193-84a0-16bd5d74a537 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.307927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc0b3-3965-4487-8495-49a95a649516 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.313401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.313566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.314926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.314926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.314926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.316801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.327413 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 787/1582] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.327802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.328377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.328520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.328798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.329064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.329695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.332085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.341024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abdca6-3a27-49d7-a81a-6bd1de9fa789 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.347244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.347906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.348272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.348519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.349166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.351114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.357801 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 796/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.357801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.366932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625c12-8ddb-4d24-91d4-52888697875b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.371983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.372581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.372851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.373117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.374428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.375656 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 788/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.376407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.377076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.390347 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe059a-9795-46b0-9e7d-13ef76923d13 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.396035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.396720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.397070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.397510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.398313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.398691 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 797/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.399482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.400587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.416699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ca6e-e66f-4984-8cd2-d0190c78f67b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.418769 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 789/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.420128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.428838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.429659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.429973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.430402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.431408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.434794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.435301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad91b01-7a6c-43bb-94ab-f9684666031d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.442022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.442900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.443365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.444002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.445051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.447668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.461374 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 790/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.463020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.466597 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 798/1588] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:56.467931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.472621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8681d-14d4-489a-a077-2a0c647a8972 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.477677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.478323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.478597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.478888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] PATH_INFO: `/v3/projects/2b012f0f3d40474f8b672dc6bfbff24d/users/bfe5047fd5fc46f9bd9ed3c037c554ab/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.480345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c876e2-7afd-4c5f-a10c-d4b55af56871 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.486566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.487291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.487715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.488142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.488987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.491040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.493351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b012f0f3d40474f8b672dc6bfbff24d, user_id=bfe5047fd5fc46f9bd9ed3c037c554ab, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.496027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.501844 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 799/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.502721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.513140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8b5e-5812-4b03-82ca-54656edd8b1a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.513984 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 791/1590] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:56 2022] PUT /identity/v3/projects/2b012f0f3d40474f8b672dc6bfbff24d/users/bfe5047fd5fc46f9bd9ed3c037c554ab/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:56.514975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.536229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.571866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.580369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.581288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.582050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.582722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.583798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.583917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7f1b-96a2-447d-a089-40ec9543acfa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.585597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.589615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.590232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.590505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.590771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.591421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.593080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.596215 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 800/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.597007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.607492 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 792/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.607492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.607793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f3653-458f-4d36-9a0e-d484da682a04 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.611194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.611819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.612091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.612355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.612989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.614570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.617545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445206a-e560-4cea-a244-262e2ed1314a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.622489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.623085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.623390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.623660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.624322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.625268 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 801/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.625897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.626077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.635411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035a5ed-cf2e-4d50-a91d-ecba50e7e743 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.637861 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 793/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.638662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.642610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.643309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.643696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.644079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.644955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.646716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe7fd-21db-482a-9d53-c7abc95e6a2f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.648771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40e74e-260b-403a-a5e3-7dffaec4ef8d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.653516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.654100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.654393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.654656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.655293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.656889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.657019 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 802/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.658117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.658422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.658663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.668539 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 794/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.672329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.677618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:56.678812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:56.682628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc68-ea46-4b32-99ac-6f2890a894e4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.686892 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 803/1597] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:56.687281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.687792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.687899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.688107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.688372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.689009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.690598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.697955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d9e81-8423-471a-b030-bacc5dfc29c4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.704851 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 795/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.704851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.706522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.707108 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.707378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.707658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.708861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.710118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.712414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734da-e0ee-4e98-aa84-a022ba9a7a95 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.716949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.717590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.717864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.718136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] PATH_INFO: `/v3/projects/a156a4b86c914a04b4d18a91759779b6/users/e848774140534fb3bf35d9197ed444a5/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.720750 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 804/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.721575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.732498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ae0f-5a22-4f02-a7d4-e183fa42fead admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.733177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a156a4b86c914a04b4d18a91759779b6, user_id=e848774140534fb3bf35d9197ed444a5, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.735865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.737485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.738128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.738403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.738667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] PATH_INFO: `/v3/projects/2cca1e4f30bf4de4954e3c77d5b5efa3/users/a63abdb89d3a41d29758ae4b7b67105c/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.749496 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 796/1600] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:56 2022] PUT /identity/v3/projects/a156a4b86c914a04b4d18a91759779b6/users/e848774140534fb3bf35d9197ed444a5/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:56.750304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.754502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca1e4f30bf4de4954e3c77d5b5efa3, user_id=a63abdb89d3a41d29758ae4b7b67105c, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.757242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.771694 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 805/1601] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:56 2022] PUT /identity/v3/projects/2cca1e4f30bf4de4954e3c77d5b5efa3/users/a63abdb89d3a41d29758ae4b7b67105c/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:56.772567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.815971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ee4f-f4c5-437d-992c-3e9715b14f7c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.842622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8be8d-5dc1-4fe9-a370-3b69a24fb662 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.847078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.847765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.848041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.848307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] PATH_INFO: `/v3/projects/7ac7a5ef43764cedb58337cbd5376304/users/c635c37222bc444a8e542379af7817fa/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.863790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7a5ef43764cedb58337cbd5376304, user_id=c635c37222bc444a8e542379af7817fa, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.866792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.877322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.878174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.878624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.879061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.879908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.881444 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 806/1602] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:56 2022] PUT /identity/v3/projects/7ac7a5ef43764cedb58337cbd5376304/users/c635c37222bc444a8e542379af7817fa/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:56.882176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:56.884693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.892594 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 797/1603] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:56.893577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:56.899862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.905545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fefa01-5a70-438f-8be6-49dbc4c1852f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.944753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a27ae-b834-4c99-a1a6-44fcd1271cfd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:56.948381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.948985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.949254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.949523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.966761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:56.967456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:56.967727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:56.968024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] PATH_INFO: `/v3/projects/ad8ba8b30d9347a3ac9272fee3d3ac67/users/b79099aa36404a66bd258a5fb16e4757/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:56.975791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.983098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8ba8b30d9347a3ac9272fee3d3ac67, user_id=b79099aa36404a66bd258a5fb16e4757, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:56.986503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.002142 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 798/1604] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:56 2022] PUT /identity/v3/projects/ad8ba8b30d9347a3ac9272fee3d3ac67/users/b79099aa36404a66bd258a5fb16e4757/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:57.002921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.021595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.023204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19749fb8-f680-40e8-8d0c-3227646a3382 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.033072 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 807/1605] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:57.034389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237856-bb98-42ad-bd46-1b8f0b2b735e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.034701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237856-bb98-42ad-bd46-1b8f0b2b735e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.035032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237856-bb98-42ad-bd46-1b8f0b2b735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.054956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1b237856-bb98-42ad-bd46-1b8f0b2b735e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.056200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1b237856-bb98-42ad-bd46-1b8f0b2b735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.073187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7d897-5ee3-4483-88fe-dee113fe6214 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.079891 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.080560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.081092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.081092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] PATH_INFO: `/v3/projects/c32ea6d5e4e74d7e9c2729691f23fe9f/users/46af30b9e2ab484f81b83e21555e8aa5/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.099363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32ea6d5e4e74d7e9c2729691f23fe9f, user_id=46af30b9e2ab484f81b83e21555e8aa5, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.103209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c77c8-e5e5-4aa0-a83c-ff39812d490d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.119105 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 799/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:57 2022] PUT /identity/v3/projects/c32ea6d5e4e74d7e9c2729691f23fe9f/users/46af30b9e2ab484f81b83e21555e8aa5/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:57.120697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cda2-7d7a-44e6-8f31-8a4ee2a9b6a4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.121180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cda2-7d7a-44e6-8f31-8a4ee2a9b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.121653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cda2-7d7a-44e6-8f31-8a4ee2a9b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.124720 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 808/1607] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.126360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.126610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.126878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.149782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.150998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.164592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d9a4cda2-7d7a-44e6-8f31-8a4ee2a9b6a4 None None] MFA Rules not processed for user `a63abdb89d3a41d29758ae4b7b67105c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.166081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9a4cda2-7d7a-44e6-8f31-8a4ee2a9b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.227072 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 809/1608] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.231193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.241526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.243949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac3652-f1eb-4aa1-944f-825d41cc04dd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.250979 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 800/1609] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.251100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.253689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.253813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.254000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.254099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.254291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.254394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] PATH_INFO: `/v3/projects/2814f05d22444ffcbef4ca182b205f72/users/73d980bfe05f4ca581a94ef8e6615274/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.281434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2814f05d22444ffcbef4ca182b205f72, user_id=73d980bfe05f4ca581a94ef8e6615274, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.288741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] MFA Rules not processed for user `b79099aa36404a66bd258a5fb16e4757`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.290143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.297133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eb1f7-2dc9-435f-b8ce-d2ee68390eea admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.317030 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 810/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:57 2022] PUT /identity/v3/projects/2814f05d22444ffcbef4ca182b205f72/users/73d980bfe05f4ca581a94ef8e6615274/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:57.323560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.323877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.324163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.355266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.356484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.374990 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 801/1611] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.376286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.402095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.436110 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 811/1612] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.436110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.436110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.467534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef807b-04cd-4b93-ab87-827c5cb91e37 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.514954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fae19-b909-4b2d-befe-05d9f00ec42c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.523067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.523699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.524053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.524325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.527773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.528729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.530660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.530954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.538527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.541470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96846d-2aef-47f8-adf1-9aeac32354c3 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.545160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.546834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.561624 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 802/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:57.562456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.563703 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 812/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:57.564873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.565156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.565423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.579951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081838ef-7fb9-4e05-9343-bfad02852b21 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.584837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:57.586625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:57.587757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.588858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.589607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.590324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.591430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.594981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.599601 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 813/1615] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:57.601041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.612772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a6142-76df-4780-82c8-a3518eadd843 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.619654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.620556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.620902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.621506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.622221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.624656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.647789 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 803/1616] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/projects => generated 403 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:57.650199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.677492 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 814/1617] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:57.680779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.703179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.764937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158be-f561-4fe3-9778-8fb8ef320329 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.825509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326ca1-360b-4943-a019-dbd066f42a97 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.831610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.832556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.833054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.833561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.858865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.859723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.859990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.860303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.928155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.929806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.934669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.936270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd821f7-8669-497b-896f-47cf9848e343 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.943286 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 815/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:57.944302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.947631 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 804/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:57.949006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3421-1aa9-42e7-8460-19cd12a2e74d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.949285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3421-1aa9-42e7-8460-19cd12a2e74d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.949580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3421-1aa9-42e7-8460-19cd12a2e74d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.951346 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 805/1620] 10.222.0.23 () {54 vars in 962 bytes} [Sun Aug 21 01:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:57.952139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c3421-1aa9-42e7-8460-19cd12a2e74d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:57.952284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.959688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551e8ca-075d-4776-aba3-1d38db0c3881 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.967711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.968457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.968800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.969211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.970417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.972531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaecac-c125-4191-a646-763ba4626d62 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:57.977083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c3421-1aa9-42e7-8460-19cd12a2e74d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:57.986021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:57.986896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:57.987002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:57.987352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:57.988097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:57.990958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.014895 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 816/1621] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/users => generated 308 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:58.017136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.017671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.018137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.024257 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 806/1622] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:08:57 2022] POST /identity/v3/users => generated 292 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:08:58.025497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.057182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f51b-e322-4fdb-860e-599a8055eacd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.063434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.064582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.065121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.066184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.067078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.070381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.078040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:58.079393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.085370 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 807/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:58.086652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.100598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c48e7-7af4-45b4-bf12-ac67d7384de3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.106766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.107567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.107971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.108341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.110284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.112132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.129315 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 808/1624] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:58.130713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.144653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f442-1fe3-427d-a5ec-fa105d36953b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.153246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.154331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.154750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.155199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] PATH_INFO: `/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e/users/11a46ca3c4f2468ca5e2cfd9da96e66f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.175982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b40a7a97be4fb694906e64e1e87b9e, user_id=11a46ca3c4f2468ca5e2cfd9da96e66f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.178854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4b0ac-eead-4e21-9b10-8177901ed0a0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.190982 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 817/1625] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Aug 21 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:58.193057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.209854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d90bf-4026-458f-a6f3-4d4d9c77b2db None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.219615 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 809/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:58 2022] PUT /identity/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e/users/11a46ca3c4f2468ca5e2cfd9da96e66f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:58.221984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d78c7-eea4-452f-b772-e6e1e21afb68 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.225027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d78c7-eea4-452f-b772-e6e1e21afb68 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.225405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d78c7-eea4-452f-b772-e6e1e21afb68 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.228729 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 810/1627] 10.222.0.23 () {54 vars in 912 bytes} [Sun Aug 21 01:08:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:08:58.229675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d78c7-eea4-452f-b772-e6e1e21afb68 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.269125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:58.326529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.327367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.327760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.328104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] PATH_INFO: `/v3/projects/dd05f82cba8143268ed338434c4a2bf3/users/3e3a369473774e1b855a767bc695d782/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.343640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d78c7-eea4-452f-b772-e6e1e21afb68 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.350930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd05f82cba8143268ed338434c4a2bf3, user_id=3e3a369473774e1b855a767bc695d782, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.351553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.352359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.352747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.353133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.354066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.354815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ded78-360c-41b7-8578-4828b1944d66 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.356180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.384530 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 818/1628] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:58 2022] PUT /identity/v3/projects/dd05f82cba8143268ed338434c4a2bf3/users/3e3a369473774e1b855a767bc695d782/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:58.387977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1b42-4a2b-46d0-8421-4eaecc9db5ce None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.388269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1b42-4a2b-46d0-8421-4eaecc9db5ce None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.389955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba1b42-4a2b-46d0-8421-4eaecc9db5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.390929 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 811/1629] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:58.392208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.403608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8311f-c807-4797-8fa4-d5c12e207ad3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.439804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d9ba1b42-4a2b-46d0-8421-4eaecc9db5ce None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:58.441035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9ba1b42-4a2b-46d0-8421-4eaecc9db5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.509827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.511129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.511731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.512423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.515260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.517581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.537301 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 812/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:08:58.540957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.555352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:58.560159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382a78-ac79-443b-8f9d-9ec0c8b45d4a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.571174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.572836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.573301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.573778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] PATH_INFO: `/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e/users/11a46ca3c4f2468ca5e2cfd9da96e66f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.579448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b40a7a97be4fb694906e64e1e87b9e, user_id=11a46ca3c4f2468ca5e2cfd9da96e66f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.585006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.605809 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 813/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:58 2022] PUT /identity/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e/users/11a46ca3c4f2468ca5e2cfd9da96e66f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:58.607483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.625858 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 819/1632] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:58.627186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88db1c-47df-4921-a8a4-3a299927e93a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.627538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88db1c-47df-4921-a8a4-3a299927e93a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.627730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88db1c-47df-4921-a8a4-3a299927e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.682188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cd88db1c-47df-4921-a8a4-3a299927e93a None None] MFA Rules not processed for user `11a46ca3c4f2468ca5e2cfd9da96e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:58.687253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cd88db1c-47df-4921-a8a4-3a299927e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.743720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709451c2-b861-4550-91a7-f87a210e57d0 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.749550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.750293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.750640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.751195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] PATH_INFO: `/v3/projects/dd05f82cba8143268ed338434c4a2bf3/users/3e3a369473774e1b855a767bc695d782/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.753250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd05f82cba8143268ed338434c4a2bf3, user_id=3e3a369473774e1b855a767bc695d782, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:58.756877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:58.779803 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 814/1633] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:08:58 2022] PUT /identity/v3/projects/dd05f82cba8143268ed338434c4a2bf3/users/3e3a369473774e1b855a767bc695d782/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:08:58.781797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:58.835392 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 820/1634] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:58.835392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.835392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.835392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:58.876014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] MFA Rules not processed for user `3e3a369473774e1b855a767bc695d782`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:58.876658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:58.878305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:58.907386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6014d-02ab-48ff-8bca-c9701b1afe9b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:58.917023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:58.917744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:58.918024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:58.918329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:59.008353 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 821/1635] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:59.009223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:59.023998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5d89-669c-496e-af6f-27ebcb868c40 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:59.029088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:59.029813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:59.030155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:59.030483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:59.102486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:59.105111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:59.107323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:59.132417 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 815/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:59.133558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:59.135349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:59.157519 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 822/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:59.212558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:59.224358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245a0ac-5c80-405d-877c-b3992ae17c48 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:59.229864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:59.231240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:59.233058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:59.233610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:59.247103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:59.248964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:59.267943 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 816/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:59.663910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:59.676734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60760d5f-80f1-463b-b8fb-918e9cd2fced service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:59.699818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:59.703650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:59.704635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:59.706209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:59.834294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:59.945079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:59.946729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ad4b2-72f6-4bdb-aa0e-3ec0eaf3903c service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:59.970579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf137e-ed5e-478d-999f-978fe5c31a00 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:59.975728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:59.976480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:59.976828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:59.977163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] PATH_INFO: `/v3/users/a63abdb89d3a41d29758ae4b7b67105c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:59.978381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63abdb89d3a41d29758ae4b7b67105c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:59.978558 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 823/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:59.980175 dv-cinder-master-3-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:59.980175 dv-cinder-master-3-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 21 01:08:59.980175 dv-cinder-master-3-smb devstack@keystone.service[81509]: Aug 21 01:08:59.981587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:00.104351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63abdb89d3a41d29758ae4b7b67105c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:00.153027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63abdb89d3a41d29758ae4b7b67105c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:00.159533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:00.171566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63abdb89d3a41d29758ae4b7b67105c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:00.173907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63abdb89d3a41d29758ae4b7b67105c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:00.175450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63abdb89d3a41d29758ae4b7b67105c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:00.228814 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 817/1640] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:08:59 2022] DELETE /identity/v3/users/a63abdb89d3a41d29758ae4b7b67105c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:00.233334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f9a6-bb3a-47e3-8d62-4f79ab2f8900 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:00.233613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f9a6-bb3a-47e3-8d62-4f79ab2f8900 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:00.233989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415f9a6-bb3a-47e3-8d62-4f79ab2f8900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:00.282469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5415f9a6-bb3a-47e3-8d62-4f79ab2f8900 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:00.285664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5415f9a6-bb3a-47e3-8d62-4f79ab2f8900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:00.527173 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 824/1641] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:00.596391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:00.598766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:00.783602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6850ea-704c-4b76-8953-813a1e506f7c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:00.794054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:00.794649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:00.794929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:00.795206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:00.819099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:00.823668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954c13-760e-4900-9221-258a34bf5a97 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:00.844102 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 818/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:01.455591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b07f-fa3a-467a-a385-7af2262f107b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:01.456240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b07f-fa3a-467a-a385-7af2262f107b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:01.456335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b07f-fa3a-467a-a385-7af2262f107b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:01.458645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 825/1643] 10.222.0.23 () {54 vars in 962 bytes} [Sun Aug 21 01:09:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:01.471782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:01.472276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:01.472685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:01.512848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:01.514432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:01.700166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b13a1-b07b-4ca7-abe8-6b9263c66ec3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:01.700557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b13a1-b07b-4ca7-abe8-6b9263c66ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:01.700921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b13a1-b07b-4ca7-abe8-6b9263c66ec3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:01.702743 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 826/1644] 10.222.0.23 () {54 vars in 912 bytes} [Sun Aug 21 01:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:09:01.708690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:01.709265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:01.709658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:01.713355 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 819/1645] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Aug 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:01.734348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:01.735052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:01.766780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:01.767627 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 827/1646] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:01.769044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:01.903279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036847-0881-4eb8-b8b0-ac6d68e9b62b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:01.907704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:01.908539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:01.908915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:01.909541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:01.927864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:01.929899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:01.952917 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:01.956533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:01.982032 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 820/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:01.997319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5ec8-56ad-4cac-ae06-000dd1d707d8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:02.028466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:02.029332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:02.029704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:02.030653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] PATH_INFO: `/v3/projects/2cca1e4f30bf4de4954e3c77d5b5efa3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:02.033819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cca1e4f30bf4de4954e3c77d5b5efa3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:02.046976 dv-cinder-master-3-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:09:02.046976 dv-cinder-master-3-smb devstack@keystone.service[81510]: warnings.warn(msg) Aug 21 01:09:02.046976 dv-cinder-master-3-smb devstack@keystone.service[81510]: Aug 21 01:09:02.049361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:02.273054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cca1e4f30bf4de4954e3c77d5b5efa3', 'request_id': 'req-967411d4-4088-4426-8dd2-63c36de5976e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.305131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cca1e4f30bf4de4954e3c77d5b5efa3', 'request_id': 'req-967411d4-4088-4426-8dd2-63c36de5976e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.331562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cca1e4f30bf4de4954e3c77d5b5efa3', 'request_id': 'req-967411d4-4088-4426-8dd2-63c36de5976e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.383290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:02.396713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] The token cache is being invalidate because project 2cca1e4f30bf4de4954e3c77d5b5efa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:02.398766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.400290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.409247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:02.411342 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 828/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:01 2022] DELETE /identity/v3/projects/2cca1e4f30bf4de4954e3c77d5b5efa3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:02.440586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675041d-78ca-47e0-83fb-00fbeea7e2db service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:02.497209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:02.588308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:02.594620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:02.594972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:02.595252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] PATH_INFO: `/v3/users/11a46ca3c4f2468ca5e2cfd9da96e66f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:02.598755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a46ca3c4f2468ca5e2cfd9da96e66f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:02.612669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:02.737279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a46ca3c4f2468ca5e2cfd9da96e66f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.786236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a46ca3c4f2468ca5e2cfd9da96e66f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.811297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a46ca3c4f2468ca5e2cfd9da96e66f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.812497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a46ca3c4f2468ca5e2cfd9da96e66f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.813548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9c3de3ba-7884-4152-9022-a8513fd2111a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a46ca3c4f2468ca5e2cfd9da96e66f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:02.860970 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 821/1649] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:02 2022] DELETE /identity/v3/users/11a46ca3c4f2468ca5e2cfd9da96e66f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:05.345999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:05.347545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:05.370240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967411d4-4088-4426-8dd2-63c36de5976e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:05.518742 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:05.519422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.519698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.520019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] PATH_INFO: `/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.521766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b40a7a97be4fb694906e64e1e87b9e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:05.523439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:05.636931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b40a7a97be4fb694906e64e1e87b9e', 'request_id': 'req-93684053-56db-4bbf-a9b5-22d20ce8ad50'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:05.656439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b40a7a97be4fb694906e64e1e87b9e', 'request_id': 'req-93684053-56db-4bbf-a9b5-22d20ce8ad50'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:05.695721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b40a7a97be4fb694906e64e1e87b9e', 'request_id': 'req-93684053-56db-4bbf-a9b5-22d20ce8ad50'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:05.747594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] The token cache is being invalidate because project f8b40a7a97be4fb694906e64e1e87b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:05.747594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:05.747920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-93684053-56db-4bbf-a9b5-22d20ce8ad50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:05.757216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:05.758024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:05.758439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:05.759782 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 829/1650] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:05 2022] DELETE /identity/v3/projects/f8b40a7a97be4fb694906e64e1e87b9e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:05.834584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:05.835844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:06.008571 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 822/1651] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:06.016428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.018053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.018053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.061743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:06.063803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:06.098293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.099384 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 830/1652] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:06.112059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9eef5-af87-4ec7-980f-7b329d4fb32e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.137354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.138258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.138365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.138606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.139266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:06.139568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.141221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.170996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.175348 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 823/1653] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:09:06.194075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805814c4-ad80-453f-b6fd-d9f955f22871 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.202308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.202954 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.203240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.204401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.205071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.210879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.276966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.284529 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 831/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:06 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:06.299275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e9b10-970e-4905-83c6-66a66e254a20 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.412745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:06.474051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.474957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.476448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.476924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.481040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.483313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.537477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.538550 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 824/1655] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:06 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:06.554529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8181-9b7c-4c3b-9716-29e13fc6e4fe admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.565030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.567223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.567546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.568323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.568774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.574662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.603517 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 832/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:06.605371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.617110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc123-db08-424f-89ad-f00ad49f69b7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.633951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.634816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.635299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.635881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.636745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.638967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483d5f9-7eba-4817-b421-dcc721c2f9ef admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.664019 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 825/1657] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:06.668904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:06.692265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e80ee-b502-432b-85f5-ed13d539559f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:06.709546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:06.710376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.710669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.711046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] PATH_INFO: `/v3/projects/743911c5748f4c3c8f1f9fa3dd035113/users/bb7cea527e8f4736bcae690e27b329b7/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.749155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743911c5748f4c3c8f1f9fa3dd035113, user_id=bb7cea527e8f4736bcae690e27b329b7, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:06.751063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:06.782593 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 833/1658] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:06 2022] PUT /identity/v3/projects/743911c5748f4c3c8f1f9fa3dd035113/users/bb7cea527e8f4736bcae690e27b329b7/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:06.795255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:06.795899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:06.796030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:06.886246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] MFA Rules not processed for user `bb7cea527e8f4736bcae690e27b329b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:06.888993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:07.057614 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 826/1659] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:07.058616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:07.121216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:07.209047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfca04-60b5-4364-92ae-d9effb687443 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:07.219455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:07.221289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:07.221571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:07.221842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:07.223444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:07.229137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:07.315573 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 834/1660] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:07 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:07.318890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:07.344314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e3cf-b9fd-4c8a-98d8-0ed6de4245bb None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:07.524541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:07.525316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:07.526294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:07.527421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:07.535134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:07.539973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:07.607633 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 827/1661] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:07 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:07.611861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:07.628393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eca01-eae8-489b-b41c-3f00af5a9ae8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:07.639320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:07.642148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:07.642618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:07.642894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:07.643570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:07.648528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:07.678161 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 835/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:07.682448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:07.697547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e40-2d01-4494-be4c-b0452ef1f1ec admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:07.712692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:07.713327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:07.713609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:07.713991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] PATH_INFO: `/v3/projects/5b19b51cc9904fb39f17926f2ff9859f/users/7b2c0bf0f3a54352905950fe7e45f9ea/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:07.754426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19b51cc9904fb39f17926f2ff9859f, user_id=7b2c0bf0f3a54352905950fe7e45f9ea, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:07.759700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:07.798628 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 828/1663] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:07 2022] PUT /identity/v3/projects/5b19b51cc9904fb39f17926f2ff9859f/users/7b2c0bf0f3a54352905950fe7e45f9ea/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:07.802848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:07.823374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04aec3-791e-4afe-918b-05b5bf45d0bc admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:07.971075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:07.971717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:07.972020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:07.972293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:07.972988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:07.975009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bdb9a-285d-4b1f-b978-eb2e8224e5d6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:07.999983 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 836/1664] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:08.003894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:08.010958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:08.023309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e62d8-68ad-4444-bef2-61237df988c7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:08.037312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:08.038249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:08.038539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:08.038836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] PATH_INFO: `/v3/projects/5b19b51cc9904fb39f17926f2ff9859f/users/7b2c0bf0f3a54352905950fe7e45f9ea/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:08.041444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19b51cc9904fb39f17926f2ff9859f, user_id=7b2c0bf0f3a54352905950fe7e45f9ea, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:08.044210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:08.071645 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 829/1665] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:08 2022] PUT /identity/v3/projects/5b19b51cc9904fb39f17926f2ff9859f/users/7b2c0bf0f3a54352905950fe7e45f9ea/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:08.081596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e7af-6bdd-48cb-a116-c284bf8dd713 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:08.081880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e7af-6bdd-48cb-a116-c284bf8dd713 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:08.082497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e7af-6bdd-48cb-a116-c284bf8dd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:08.169619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ec73e7af-6bdd-48cb-a116-c284bf8dd713 None None] MFA Rules not processed for user `7b2c0bf0f3a54352905950fe7e45f9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:08.170844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ec73e7af-6bdd-48cb-a116-c284bf8dd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:08.383847 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 837/1666] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:08.397041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:08.402863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:08.609952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1225-c58b-48b2-a197-93e74938276f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:08.621030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:08.621685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:08.624449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:08.624749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:08.663101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:08.666815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:08.692168 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 830/1667] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:08.859812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:08.860365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:08.860365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:08.946534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] MFA Rules not processed for user `e848774140534fb3bf35d9197ed444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:08.950334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:08.974949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:09.123390 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 838/1668] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:09.137498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:09.139198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:09.458567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6148-8103-4d75-92a0-eac197919342 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:09.485081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:09.487782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:09.489031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:09.489528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:09.551542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:09.554965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:09.579659 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 831/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:09.861883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:09.935180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:09.936799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:10.071876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff00ce-ebd5-45d2-957c-2c5f4aec1314 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:10.093220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:10.095499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.097080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.097384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] PATH_INFO: `/v3/users/bb7cea527e8f4736bcae690e27b329b7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.102203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7cea527e8f4736bcae690e27b329b7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:10.108154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:10.137036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c3848-67da-41f3-8660-d3b2ea3db937 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:10.159126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:10.159813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.160092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.160359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] PATH_INFO: `/v3/users/7bc45cf3b94b46729e07483f996d1f5e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.171072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc45cf3b94b46729e07483f996d1f5e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:10.173281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:10.248260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7cea527e8f4736bcae690e27b329b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.249210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7cea527e8f4736bcae690e27b329b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.258175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:10.274341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7cea527e8f4736bcae690e27b329b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.287261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7cea527e8f4736bcae690e27b329b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.314515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc45cf3b94b46729e07483f996d1f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.339188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-730f1033-b217-40f3-9e86-75b9ed07e7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7cea527e8f4736bcae690e27b329b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.349235 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 839/1670] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:09 2022] DELETE /identity/v3/users/bb7cea527e8f4736bcae690e27b329b7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:10.355308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.355852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.356269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.374484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc45cf3b94b46729e07483f996d1f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.390500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:10.392135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:10.398691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc45cf3b94b46729e07483f996d1f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.399910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc45cf3b94b46729e07483f996d1f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.400780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-55a61b8c-da4e-48e3-881a-4b84247780b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc45cf3b94b46729e07483f996d1f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:10.434791 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 832/1671] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:09 2022] DELETE /identity/v3/users/7bc45cf3b94b46729e07483f996d1f5e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:10.436981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.438878 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.439764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.465951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:10.494258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:10.501145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:10.543097 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 840/1672] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:10.663202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:10.664499 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 833/1673] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:10.667655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:10.684631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:10.686689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:10.862574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b966345-1b52-4a34-9a80-874925e475f6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:10.870489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:10.872597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.872995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.873386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.873790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab991d-4a69-45fd-abbd-1d77d5bf4797 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:10.880600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:10.881587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:10.882091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:10.882672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:10.899205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:10.901605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:10.902063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189508-8d9c-488e-892a-1af2a4e45fb7 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:10.906541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:10.929812 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 834/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:10.933272 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 841/1675] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:12.581522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:12.583453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:12.612365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9156-187b-4e3f-a7ac-b5fb0aa30c8d service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:12.641167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:12.641851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:12.642133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:12.642396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] PATH_INFO: `/v3/projects/419393058b0c49298d8addbf8b58eefc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:12.648756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=419393058b0c49298d8addbf8b58eefc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:12.650724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:12.753448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:12.775282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419393058b0c49298d8addbf8b58eefc', 'request_id': 'req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.796305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419393058b0c49298d8addbf8b58eefc', 'request_id': 'req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.820345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419393058b0c49298d8addbf8b58eefc', 'request_id': 'req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.838171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] The token cache is being invalidate because project 419393058b0c49298d8addbf8b58eefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:12.839680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.841824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4b9b9b16-7ae0-4170-bb34-5fc7a5346c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:12.861218 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 835/1676] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:12 2022] DELETE /identity/v3/projects/419393058b0c49298d8addbf8b58eefc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:12.865506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24db0a7-a0db-426a-b13b-7ea836b9620c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:12.866530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24db0a7-a0db-426a-b13b-7ea836b9620c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:12.866957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24db0a7-a0db-426a-b13b-7ea836b9620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:12.932637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b24db0a7-a0db-426a-b13b-7ea836b9620c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:12.934354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b24db0a7-a0db-426a-b13b-7ea836b9620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.049222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182c18-f48e-48f9-be9a-17b64f23b167 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.050076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182c18-f48e-48f9-be9a-17b64f23b167 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.050533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182c18-f48e-48f9-be9a-17b64f23b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.096352 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 842/1677] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:13.104363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.105230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.105710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.144746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1d182c18-f48e-48f9-be9a-17b64f23b167 None None] MFA Rules not processed for user `c635c37222bc444a8e542379af7817fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:13.147076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1d182c18-f48e-48f9-be9a-17b64f23b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.160078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:13.163035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.186593 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 843/1678] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:13.192896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.213327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307011d-4802-4e92-954b-7733cd0daf8e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.225892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.226853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.227335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.227857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.230835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:13.231333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.237706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.265018 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 844/1679] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:09:13.269810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.296505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816bc8-c68b-4713-8acc-d9bfe1d77a31 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.302210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.303114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.303531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.303985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.304779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.307021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.353646 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 836/1680] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:13.355338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.355522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.355937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.361349 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 845/1681] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:13.364909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.386159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] MFA Rules not processed for user `c635c37222bc444a8e542379af7817fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:13.388725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.449087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:13.518208 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 837/1682] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:13.525260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7100-c8b1-446d-9360-cbc494f81267 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.534872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.537321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.537981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.538260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.541140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.541272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.541997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.546295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.599208 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 846/1683] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:13.603348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.621352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fd01-cc6d-4b60-8b8e-3e84d98b7fe2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.634579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.635342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.635643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.636161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.636802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.638506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.670294 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 847/1684] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:13.675569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.694806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:13.697030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbf98-0f96-46d0-8f19-7d832a112fbd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.708346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.709062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.709345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.712368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.713132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.716681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.722016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526bcf2-1b4b-4bff-8df7-e55b34307428 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.730757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.731404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.731684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.732574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.744161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.746866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce8873-a3e9-44f8-8c16-c9072f9c34df service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.749485 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 848/1685] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:13.753609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.774750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462b93-67d4-4c22-b04d-09ec0c90084f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:13.777103 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 838/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:13.791456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:13.792323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.792698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.793064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] PATH_INFO: `/v3/projects/ed875b72294c4850be8e7f45facf55fc/users/1d39b6469933445ba215ba427df5c302/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.824477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed875b72294c4850be8e7f45facf55fc, user_id=1d39b6469933445ba215ba427df5c302, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:13.827378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:13.856432 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 849/1687] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:13 2022] PUT /identity/v3/projects/ed875b72294c4850be8e7f45facf55fc/users/1d39b6469933445ba215ba427df5c302/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:13.861525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:13.862028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:13.862307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:13.880038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:13.881920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:13.911126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:13.915929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:14.079033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f16917-923b-4238-98c0-c72f0d1cb4f3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:14.091639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:14.093183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:14.093770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:14.094232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] PATH_INFO: `/v3/projects/743911c5748f4c3c8f1f9fa3dd035113` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:14.096602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743911c5748f4c3c8f1f9fa3dd035113)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:14.098922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:14.103614 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 839/1688] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:14.153187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:14.154563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:14.218935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743911c5748f4c3c8f1f9fa3dd035113', 'request_id': 'req-9aa17dbb-a174-4d88-ae37-fb694f35c409'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.241029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743911c5748f4c3c8f1f9fa3dd035113', 'request_id': 'req-9aa17dbb-a174-4d88-ae37-fb694f35c409'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.260102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743911c5748f4c3c8f1f9fa3dd035113', 'request_id': 'req-9aa17dbb-a174-4d88-ae37-fb694f35c409'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.279444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] The token cache is being invalidate because project 743911c5748f4c3c8f1f9fa3dd035113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:14.279936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.281310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.284109 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 850/1689] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:13 2022] DELETE /identity/v3/projects/743911c5748f4c3c8f1f9fa3dd035113 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:14.292029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:14.293851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:14.314407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:14.364052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368dc96-871c-41db-a97f-20378d5223bd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:14.501383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17dbb-a174-4d88-ae37-fb694f35c409 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:14.513362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:14.514079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:14.514308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:14.514674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] PATH_INFO: `/v3/users/7b2c0bf0f3a54352905950fe7e45f9ea` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:14.517759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:14.518411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:14.518694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:14.518972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:14.522462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2c0bf0f3a54352905950fe7e45f9ea)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:14.530443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:14.530750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:14.604124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:14.606599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8533b8-7ba5-46d2-b77f-05634c8baeaf service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:14.658286 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 840/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:14.698551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2c0bf0f3a54352905950fe7e45f9ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.699236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2c0bf0f3a54352905950fe7e45f9ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.711971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2c0bf0f3a54352905950fe7e45f9ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.729715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2c0bf0f3a54352905950fe7e45f9ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.755883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a706aae5-8a44-41e5-9bb7-03b3cf5e1db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2c0bf0f3a54352905950fe7e45f9ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:14.769156 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 851/1691] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:14 2022] DELETE /identity/v3/users/7b2c0bf0f3a54352905950fe7e45f9ea => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:15.996351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:15.996351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:15.996351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.025328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] MFA Rules not processed for user `e848774140534fb3bf35d9197ed444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:16.026812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.105495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abde9e-141d-4a30-aa2e-73cb402c4855 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.106231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abde9e-141d-4a30-aa2e-73cb402c4855 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.106654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abde9e-141d-4a30-aa2e-73cb402c4855 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.108272 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 852/1692] 10.222.0.23 () {54 vars in 912 bytes} [Sun Aug 21 01:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:16.114539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:16.126080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.126641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.127057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.153291 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 841/1693] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:16.219713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:16.223360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.381168 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 853/1694] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:16.522045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:16.524059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:16.554690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa42f-6ccf-41e6-b8b0-36f573d2e2ee None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:16.566287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:16.567334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:16.574787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:16.575892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:16.595377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:16.598114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfe5fd-201f-4a43-b28a-245959c5794f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:16.623458 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 842/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:17.445876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:17.448152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:17.520992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:17.568259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac067b1-cccc-4018-9ed5-c64067fca393 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.568915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac067b1-cccc-4018-9ed5-c64067fca393 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.568915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac067b1-cccc-4018-9ed5-c64067fca393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.660989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cac067b1-cccc-4018-9ed5-c64067fca393 None None] MFA Rules not processed for user `1d39b6469933445ba215ba427df5c302`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:17.662666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cac067b1-cccc-4018-9ed5-c64067fca393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:17.668816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a95346-214c-4d73-a246-eac76cfa804a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:17.677257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:17.678008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.678227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.678502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] PATH_INFO: `/v3/projects/5b19b51cc9904fb39f17926f2ff9859f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.680745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b19b51cc9904fb39f17926f2ff9859f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:17.683248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:17.821466 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 843/1696] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:17.823327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.825065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.835966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:17.843954 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 844/1697] 10.222.0.23 () {54 vars in 912 bytes} [Sun Aug 21 01:09:17 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:17.845160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:17.845322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b19b51cc9904fb39f17926f2ff9859f', 'request_id': 'req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:17.858800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:17.862654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b19b51cc9904fb39f17926f2ff9859f', 'request_id': 'req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:17.880426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b19b51cc9904fb39f17926f2ff9859f', 'request_id': 'req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:17.944510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] The token cache is being invalidate because project 5b19b51cc9904fb39f17926f2ff9859f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:17.958858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:17.965034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c5a436d4-9f6f-44c7-8d48-9f7b4641a329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:17.969710 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 854/1698] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:17 2022] DELETE /identity/v3/projects/5b19b51cc9904fb39f17926f2ff9859f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:17.971983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:17.972706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:17.973123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.061464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:18.066123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.112820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae290920-e98c-4d2e-b8bb-2d983d60c5c3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.143864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.144580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.148805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.149098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.152000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.156963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2d0f-ed95-4fb2-9bb7-22dd39823888 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.232078 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 845/1699] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:17 2022] POST /identity/v3/projects => generated 405 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:18.233620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.234417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.236283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.313142 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 855/1700] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:18.314811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.317588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.320747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:18.323034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.355567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123414e-361d-4d73-9343-7d7f28ee36cf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.456501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:18.460489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.462991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.463632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.465069 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.466092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.468819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c64d9a-6926-4458-b29f-c79bed33c573 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.493083 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 846/1701] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:18.494187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.497433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.502337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:18.529732 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 856/1702] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:18 2022] POST /identity/v3/users => generated 309 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:18.532277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9126-be90-42e5-b092-b85ddd3acf1c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.532628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9126-be90-42e5-b092-b85ddd3acf1c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.532920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9126-be90-42e5-b092-b85ddd3acf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.571195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-651d9126-be90-42e5-b092-b85ddd3acf1c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:18.572856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-651d9126-be90-42e5-b092-b85ddd3acf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.586047 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 857/1703] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:18.587687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e5bc-33de-482d-ace5-fc73573a17ff None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.587997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e5bc-33de-482d-ace5-fc73573a17ff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.588309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e5bc-33de-482d-ace5-fc73573a17ff None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.591339 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 858/1704] 10.222.0.23 () {54 vars in 961 bytes} [Sun Aug 21 01:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:18.601229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e5bc-33de-482d-ace5-fc73573a17ff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.619342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e5bc-33de-482d-ace5-fc73573a17ff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.628355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.628982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.629257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.629563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.632466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.634151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.654353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015f56-c506-4f49-aac4-31ee9ae278fe None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.657839 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 859/1705] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:18.664642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.666753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.667398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.667669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.667965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.681935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.683472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76161c9-1cd8-4aab-87d5-5ff82a038abe service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.695256 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 847/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:18.696846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.696959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.697253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.700102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f7b6d-44fd-48de-9ffd-47bd4f3f38ec admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.715615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.716680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.717175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.717648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.718820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:18.719331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.722118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.736822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:18.738050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:18.744401 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 860/1707] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:18.746993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.772187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23f09-b17a-489e-9d41-8595a7812c90 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:18.791343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:18.792874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:18.795402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:18.795967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] PATH_INFO: `/v3/projects/2b15e62683244c7bbf1cfbcad289d009/users/df571e4d92d8466db4a855337301a00d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:18.828535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b15e62683244c7bbf1cfbcad289d009, user_id=df571e4d92d8466db4a855337301a00d, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:18.837156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:18.868807 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 861/1708] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:18 2022] PUT /identity/v3/projects/2b15e62683244c7bbf1cfbcad289d009/users/df571e4d92d8466db4a855337301a00d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:18.870268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.905469 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 848/1709] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Aug 21 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:18.912125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:18.937192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883235c-ed36-4fbc-a074-e101b22cd7e7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.025848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2f0c-8d90-4ba9-b5c8-830e3ab416fd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.037840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.039804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.040886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.041374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.042189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.045813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.061905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.062626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.062981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.063379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.064737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.066579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.083702 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 849/1710] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:19.087130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.113435 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 862/1711] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:18 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:19.116123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.177251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:19.232818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e582-4c92-46bc-8874-175977e8ce34 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.238515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.239483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.240030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.240681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] PATH_INFO: `/v3/projects/2b15e62683244c7bbf1cfbcad289d009/users/df571e4d92d8466db4a855337301a00d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.242910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b15e62683244c7bbf1cfbcad289d009, user_id=df571e4d92d8466db4a855337301a00d, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.252634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.255230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d889-2742-4ec4-8f35-eae8d6253ae7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.276982 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 863/1712] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:19 2022] PUT /identity/v3/projects/2b15e62683244c7bbf1cfbcad289d009/users/df571e4d92d8466db4a855337301a00d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:19.278373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.371715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:19.431120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.431451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.431690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.432024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.441688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:19.476397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.479826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6b6a-f5a2-4644-9af5-53d87bf339be service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.499437 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 850/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:19.517918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.518918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.519278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.571421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59402-e99d-4ab0-a10d-5a4a89af3fd4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.574564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] MFA Rules not processed for user `c635c37222bc444a8e542379af7817fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:19.577933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:19.608789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.609419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.609699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.609970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.610622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.624590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.726808 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 864/1714] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:19 2022] POST /identity/v3/users => generated 294 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:19.738065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.767941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01661-3b40-4b41-a19e-1606744be89d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.781653 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 851/1715] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:19.808734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.809382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.809659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.809936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.810595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.813655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.861292 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 865/1716] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:19.865820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.890629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ae1d-77eb-40e3-8058-5bd6b0686369 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.905444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.905971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.906326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.906504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:19.907152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:19.910199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33c63-cc87-41c0-820f-ba6b46dc2b82 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:19.941442 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 852/1717] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:19.943603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:19.971932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774185-923b-4a04-a878-c0e3db230808 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:19.982544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:19.983236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:19.983515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:19.983811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] PATH_INFO: `/v3/projects/bb1c54c5ed1b44e58e41454af9e39f2d/users/40fc89c98946402f85113ceaed0b8b96/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.031853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1c54c5ed1b44e58e41454af9e39f2d, user_id=40fc89c98946402f85113ceaed0b8b96, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:20.034813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:20.074281 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 866/1718] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:19 2022] PUT /identity/v3/projects/bb1c54c5ed1b44e58e41454af9e39f2d/users/40fc89c98946402f85113ceaed0b8b96/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:20.085186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b665c2-2627-4477-9d03-acb4dc56c5c5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.085592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b665c2-2627-4477-9d03-acb4dc56c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.085741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b665c2-2627-4477-9d03-acb4dc56c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.154195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f7b665c2-2627-4477-9d03-acb4dc56c5c5 None None] MFA Rules not processed for user `40fc89c98946402f85113ceaed0b8b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:20.158946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f7b665c2-2627-4477-9d03-acb4dc56c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:20.264400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:20.323242 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 853/1719] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:20.328032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:20.472553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.472832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.473111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.474153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56dd4e-4062-4b37-b236-7cf86ce89320 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:20.481048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:20.482352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.483477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.485241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.486115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:20.490173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:20.540814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] MFA Rules not processed for user `bfe5047fd5fc46f9bd9ed3c037c554ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:20.543585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:20.558705 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 867/1720] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:20.562382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:20.750854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:20.767355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd14a5-3a83-4d98-91e6-d7f5b7d7bc6e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:20.775306 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 854/1721] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:20.788619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:20.790066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.790066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.790066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.790626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:20.792856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:20.831127 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 868/1722] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:20 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:20.832670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:20.849600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fde86-3f0b-4adb-99a4-74507aee5534 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:20.870715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:20.871645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.873531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.874005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.874840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:20.877636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:20.929176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:20.929762 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 855/1723] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:20.950445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bab2-a93c-4f89-a744-5d7d5f985a0d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:20.955353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:20.968603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:20.969844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:20.970123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:20.970852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:20.974019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:20.975999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:20.980483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:21.005053 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 869/1724] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:21.009414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:21.035286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990dcf5-7b96-4890-9881-d5f944c50d4b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:21.053686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:21.058800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:21.059433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:21.060104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] PATH_INFO: `/v3/projects/b7c37241f1764d0a8764db3896d58381/users/89b2835b1c6c468498a06eb7d8a54197/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:21.133841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c37241f1764d0a8764db3896d58381, user_id=89b2835b1c6c468498a06eb7d8a54197, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:21.147585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d719c9-d1b1-4395-a18d-79a88b2e2838 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:21.214607 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 870/1725] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:21 2022] PUT /identity/v3/projects/b7c37241f1764d0a8764db3896d58381/users/89b2835b1c6c468498a06eb7d8a54197/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:21.220080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:21.220080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:21.220080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:21.289028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebfbc-d711-4e88-a9a8-3adde51d37ea admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:21.356678 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] MFA Rules not processed for user `89b2835b1c6c468498a06eb7d8a54197`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:21.357764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:21.556194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:21.579854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:21.581466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:21.582328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:21.582877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:21.601486 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 871/1726] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:21.607391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:21.764245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:21.766122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:21.781769 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 856/1727] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:21.845725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb68a53-d6ef-4763-bc40-29dc44451a68 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:21.860092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:21.861008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:21.861444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:21.861859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:21.862650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:21.872859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5d96-2a0d-47ae-8d5f-193a10e6013a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:21.960623 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 872/1728] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:21 2022] POST /identity/v3/projects => generated 385 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:21.965338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:21.996153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90071-6ced-476e-b779-9e6441c010a9 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:22.316987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:22.317797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:22.320013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:22.320882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:22.322441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:22.326264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:22.335323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:22.335601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:22.335990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:22.401111 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 857/1729] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:21 2022] POST /identity/v3/users => generated 299 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:22.406439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] MFA Rules not processed for user `46af30b9e2ab484f81b83e21555e8aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:22.410197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:22.417506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:22.456798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:22.466646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212357a-49ba-423a-a5cf-564f51dc638e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:22.509085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:22.509301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:22.509582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:22.509861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:22.510959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:22.512649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:22.564981 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 858/1730] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:22.566470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:22.604529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408a218-a3db-4bf7-aa5e-3321ed8c3505 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:22.619650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:22.620597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:22.622711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:22.623211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] PATH_INFO: `/v3/projects/840163a12e77420187474b48d26d3c95/users/663951c00c304262b328434ea046e1d7/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:22.666842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] RBAC: Authorizing `identity:create_grant(project_id=840163a12e77420187474b48d26d3c95, user_id=663951c00c304262b328434ea046e1d7, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:22.672248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:22.683947 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 873/1731] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:22.694484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:22.704276 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 859/1732] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:22 2022] PUT /identity/v3/projects/840163a12e77420187474b48d26d3c95/users/663951c00c304262b328434ea046e1d7/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:22.709771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:22.921431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:22.941428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd73b-0f8d-4bd8-96a6-918ecb767929 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:22.963989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cd2fd-63a8-4574-b8d3-6f802789613b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:22.974489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:22.984948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:22.985669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:22.987614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:22.988612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:22.992563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:23.018617 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 860/1733] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:23.022700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:23.043242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1def3-4a9a-4036-960a-759e6f94cd37 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:23.058907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:23.061307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:23.061735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:23.064252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] PATH_INFO: `/v3/projects/840163a12e77420187474b48d26d3c95/users/663951c00c304262b328434ea046e1d7/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:23.067373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=840163a12e77420187474b48d26d3c95, user_id=663951c00c304262b328434ea046e1d7, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:23.072308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c576d-5124-4ea0-8a0d-227d59417bba admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:23.117821 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 861/1734] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:23 2022] PUT /identity/v3/projects/840163a12e77420187474b48d26d3c95/users/663951c00c304262b328434ea046e1d7/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:23.130553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790b3e-75f5-4368-b0f7-9610cdce0578 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:23.130973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790b3e-75f5-4368-b0f7-9610cdce0578 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:23.131433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790b3e-75f5-4368-b0f7-9610cdce0578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:23.167120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:23.172270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:23.172969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:23.173788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:23.233825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-82790b3e-75f5-4368-b0f7-9610cdce0578 None None] MFA Rules not processed for user `663951c00c304262b328434ea046e1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:23.238042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-82790b3e-75f5-4368-b0f7-9610cdce0578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:23.317923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:23.337947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:23.339935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:23.363358 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 874/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:23.445258 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 862/1736] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:23.455299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:23.457251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:23.642791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42dcd-a6e0-46e8-89c1-d082e039d778 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:23.772635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:23.773204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:23.773479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:23.773746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:23.810597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:23.816567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254185e-4cc2-452c-af39-d2335e0eb3bc service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:23.857417 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 875/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:24.040506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44654a2d-4469-436a-89a1-a7941460d620 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:24.041173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44654a2d-4469-436a-89a1-a7941460d620 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:24.041173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44654a2d-4469-436a-89a1-a7941460d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:24.213835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-44654a2d-4469-436a-89a1-a7941460d620 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:24.215085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-44654a2d-4469-436a-89a1-a7941460d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.388554 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 863/1738] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:24.432465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:24.433784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:24.434293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:24.505504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] MFA Rules not processed for user `73d980bfe05f4ca581a94ef8e6615274`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:24.507773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.639827 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 876/1739] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:24.652286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:24.652551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:24.652843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:24.723894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] MFA Rules not processed for user `73d980bfe05f4ca581a94ef8e6615274`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:24.728750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.752345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:24.755822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.796413 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 864/1740] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:24.809243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:24.812197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:24.942420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:24.975924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:25.080709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cd5c3-65ba-4bf0-9fda-f819cb49c8db None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:25.099005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:25.099794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:25.100068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:25.100344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:25.123095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:25.127882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf427135-5c9e-4ede-9582-70d3da74bf4c service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:25.153835 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 865/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:25.208857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb32b-d1cc-4572-9d54-24cace9de335 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:25.209258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb32b-d1cc-4572-9d54-24cace9de335 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:25.210119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb32b-d1cc-4572-9d54-24cace9de335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:25.270551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d5deb32b-d1cc-4572-9d54-24cace9de335 None None] MFA Rules not processed for user `df571e4d92d8466db4a855337301a00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:25.271571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b96a63-fae3-481b-97e4-2801ca7a6a61 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:25.272671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d5deb32b-d1cc-4572-9d54-24cace9de335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:25.319516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:25.322353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:25.322636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:25.322982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:25.392494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:25.412344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:25.462080 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 877/1742] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:09:25.464242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:25.487973 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 866/1743] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:25.496179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f83e-f88c-4b91-958c-bf89301c1ec8 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:25.509344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:25.510495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:25.511581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:25.513515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:25.658031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:25.660076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:25.684140 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 878/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:27.462055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0528-10ee-450a-be3f-fd1af842d034 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:27.462788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0528-10ee-450a-be3f-fd1af842d034 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:27.468404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0528-10ee-450a-be3f-fd1af842d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:27.528620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a45e0528-10ee-450a-be3f-fd1af842d034 None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:27.529861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a45e0528-10ee-450a-be3f-fd1af842d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:27.704661 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 867/1745] 10.222.0.64 () {58 vars in 1015 bytes} [Sun Aug 21 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:28.181507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:28.200338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124efde-5e68-4df7-8caa-942b98d0f367 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:28.212514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:28.219185 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:28.221033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:28.221773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:28.244869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:28.246706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadce9f-99dc-4bc5-aabc-6bd5b3f67cda service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:28.281641 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 879/1746] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:30.875553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:30.876134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:30.876310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:30.878134 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 868/1747] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:30.898458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:30.899548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:30.900068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:30.988258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:30.994950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:31.171412 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 880/1748] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:31.330396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:31.332907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:31.366736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da96601-2ca4-4efe-9245-b6f5a68743c0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:31.378555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:31.380335 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:31.380861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:31.381349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:31.397983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:31.401102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ddbf6-fe0e-4d77-99ef-3f8bd02bf9c7 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:31.465243 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 869/1749] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:32.055288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:32.068252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18808180-171b-44f8-a6ec-7c991224ce01 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:32.091202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:32.092064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:32.095761 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:32.096052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:32.205897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:32.309966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:32.312592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff7e2-573e-42df-a12e-ea242f7cb760 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:32.339442 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 881/1750] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:33.851532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:33.852208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:33.853212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:33.929383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] MFA Rules not processed for user `bfe5047fd5fc46f9bd9ed3c037c554ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:33.936341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:33.982715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975f94-919b-45d6-a885-27230e7d4f0d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:33.983714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975f94-919b-45d6-a885-27230e7d4f0d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:33.984167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975f94-919b-45d6-a885-27230e7d4f0d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:33.986899 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 882/1751] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:09:34.023519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:34.097521 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 870/1752] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:34.347634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e995f-63cc-47f9-9a64-7a07e19b8eb0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:34.347812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e995f-63cc-47f9-9a64-7a07e19b8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:34.348023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e995f-63cc-47f9-9a64-7a07e19b8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:34.404068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-380e995f-63cc-47f9-9a64-7a07e19b8eb0 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:34.406725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-380e995f-63cc-47f9-9a64-7a07e19b8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:34.432574 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 883/1753] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:35.638617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:35.657250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290f20-b141-4c93-8282-fba58d8f0f5e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:35.676639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:35.680592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:35.682161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:35.682688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:35.724771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:35.729150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:35.761763 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 871/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:36.588690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f069-dc7e-4312-a79a-fccb0d8949e2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:36.589556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f069-dc7e-4312-a79a-fccb0d8949e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:36.590001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f069-dc7e-4312-a79a-fccb0d8949e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:36.622150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0b85f069-dc7e-4312-a79a-fccb0d8949e2 None None] MFA Rules not processed for user `46af30b9e2ab484f81b83e21555e8aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:36.623960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0b85f069-dc7e-4312-a79a-fccb0d8949e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:36.803633 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 884/1755] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:37.076139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:37.337129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215009f-46f6-4ac5-b9ab-fabf03ce12d2 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:37.353837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:37.354505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:37.354822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:37.355441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] PATH_INFO: `/v3/users/40fc89c98946402f85113ceaed0b8b96` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:37.357223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fc89c98946402f85113ceaed0b8b96)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:37.359837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:37.461855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fc89c98946402f85113ceaed0b8b96'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:37.524280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fc89c98946402f85113ceaed0b8b96'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:37.542262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fc89c98946402f85113ceaed0b8b96'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:37.551818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fc89c98946402f85113ceaed0b8b96'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:37.558005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fc89c98946402f85113ceaed0b8b96'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:37.642017 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 872/1756] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:37 2022] DELETE /identity/v3/users/40fc89c98946402f85113ceaed0b8b96 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:37.646481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:37.647451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:37.647992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:37.701924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:37.705050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:37.887664 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 885/1757] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:37.948006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:37.949732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:37.960659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:37.962491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:37.995106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5539953-890a-4684-abd7-1e22a2718bfc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:38.020593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:38.026344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:38.029020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:38.030518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] PATH_INFO: `/v3/users/1d39b6469933445ba215ba427df5c302` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:38.034105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d39b6469933445ba215ba427df5c302)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:38.037989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:38.118595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:38.169046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c080-ebe1-45dc-bcf5-ee773509498f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:38.201854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:38.205117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:38.207441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:38.208916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:38.264721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d39b6469933445ba215ba427df5c302'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:38.266687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d39b6469933445ba215ba427df5c302'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:38.286716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d39b6469933445ba215ba427df5c302'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:38.307423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:38.315941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd6d3-b272-4c87-9f70-6ab81b503985 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:38.316506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:38.342190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d39b6469933445ba215ba427df5c302'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:38.388254 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 873/1758] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:38.400120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-454b9ed1-342f-448a-8e26-ba98388e8732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d39b6469933445ba215ba427df5c302'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:38.415617 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 886/1759] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:37 2022] DELETE /identity/v3/users/1d39b6469933445ba215ba427df5c302 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:38.653380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:38.653701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:38.654043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:38.656435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 874/1760] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:09:38.715817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757e5e-169e-4066-889b-134687267ed9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:38.716378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757e5e-169e-4066-889b-134687267ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:38.716378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757e5e-169e-4066-889b-134687267ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:38.754892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-80757e5e-169e-4066-889b-134687267ed9 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:38.756524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-80757e5e-169e-4066-889b-134687267ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:38.888716 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 887/1761] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:39.090646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:39.092628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:39.175470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc9b90-6469-4af5-87cd-cda4d61db42f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:39.183211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:39.184524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:39.184813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:39.185090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] PATH_INFO: `/v3/users/b79099aa36404a66bd258a5fb16e4757` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:39.186294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79099aa36404a66bd258a5fb16e4757)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:39.188606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:39.248269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79099aa36404a66bd258a5fb16e4757'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:39.264624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79099aa36404a66bd258a5fb16e4757'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:39.273355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79099aa36404a66bd258a5fb16e4757'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:39.274117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79099aa36404a66bd258a5fb16e4757'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:39.274732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79099aa36404a66bd258a5fb16e4757'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:39.302500 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 875/1762] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:39 2022] DELETE /identity/v3/users/b79099aa36404a66bd258a5fb16e4757 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:39.307063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:39.307358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:39.307615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:39.333503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:39.344800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:39.423305 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 888/1763] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:39.439515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:39.440855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:39.532565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5543b7-a6fb-42f4-aab4-29c309244345 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:39.543659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:39.548627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:39.549062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:39.549382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:39.574491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:39.577291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:39.616952 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 876/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:39.969581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:39.971603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:39.992223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f8ea-58ae-454b-91e2-420992db37a8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.012611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.014848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.015355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.015877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] PATH_INFO: `/v3/projects/ed875b72294c4850be8e7f45facf55fc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.018258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed875b72294c4850be8e7f45facf55fc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.022903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.125956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed875b72294c4850be8e7f45facf55fc', 'request_id': 'req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.126165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.127696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.141189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed875b72294c4850be8e7f45facf55fc', 'request_id': 'req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.143603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.153437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed875b72294c4850be8e7f45facf55fc', 'request_id': 'req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.155047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.175025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] The token cache is being invalidate because project ed875b72294c4850be8e7f45facf55fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:40.175587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.177582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.181688 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 889/1765] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:39 2022] DELETE /identity/v3/projects/ed875b72294c4850be8e7f45facf55fc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:40.186513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.188351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.256786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b784bf9-2ec1-40da-be48-4eb646f72b00 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.302983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66b99-1ee8-4499-9bc1-4af62284d0cb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.324083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.324756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.325037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.325309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] PATH_INFO: `/v3/users/df571e4d92d8466db4a855337301a00d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.326562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df571e4d92d8466db4a855337301a00d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.328553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.362776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.363758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.364252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.364676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.370261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.401026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.409368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.411008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df571e4d92d8466db4a855337301a00d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.411990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df571e4d92d8466db4a855337301a00d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.424784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df571e4d92d8466db4a855337301a00d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.433227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df571e4d92d8466db4a855337301a00d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.437403 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 877/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:40.444717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.446562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.480961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643095-21b1-4493-99a3-3cdb16988ce8 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.487522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df571e4d92d8466db4a855337301a00d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.497190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.497854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.498130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.498403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] PATH_INFO: `/v3/projects/bb1c54c5ed1b44e58e41454af9e39f2d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.500135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1c54c5ed1b44e58e41454af9e39f2d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.502053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.514948 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 890/1767] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/users/df571e4d92d8466db4a855337301a00d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:40.584444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1c54c5ed1b44e58e41454af9e39f2d', 'request_id': 'req-af646b85-c114-4ad0-b425-1e0615d43ef6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.591910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1c54c5ed1b44e58e41454af9e39f2d', 'request_id': 'req-af646b85-c114-4ad0-b425-1e0615d43ef6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.604258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1c54c5ed1b44e58e41454af9e39f2d', 'request_id': 'req-af646b85-c114-4ad0-b425-1e0615d43ef6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.623944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] The token cache is being invalidate because project bb1c54c5ed1b44e58e41454af9e39f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:40.624296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.625349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.627674 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 878/1768] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/projects/bb1c54c5ed1b44e58e41454af9e39f2d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:40.632255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.633771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.671657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.673264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.693872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.770850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c56fd-e2cb-486d-8cc9-119084e70d1b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.774810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af646b85-c114-4ad0-b425-1e0615d43ef6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.778480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.779813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.780430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.781049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] PATH_INFO: `/v3/users/89b2835b1c6c468498a06eb7d8a54197` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.782619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b2835b1c6c468498a06eb7d8a54197)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.782738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.783348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.783630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.786038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] PATH_INFO: `/v3/projects/ad8ba8b30d9347a3ac9272fee3d3ac67` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.787906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8ba8b30d9347a3ac9272fee3d3ac67)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.788790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.792084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.804636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.844447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b2835b1c6c468498a06eb7d8a54197'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.845087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b2835b1c6c468498a06eb7d8a54197'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.855028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b2835b1c6c468498a06eb7d8a54197'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.856000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8ba8b30d9347a3ac9272fee3d3ac67', 'request_id': 'req-8da46d31-04c3-4855-ba90-76599ecc5fd9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.863973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b2835b1c6c468498a06eb7d8a54197'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.868383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8ba8b30d9347a3ac9272fee3d3ac67', 'request_id': 'req-8da46d31-04c3-4855-ba90-76599ecc5fd9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.883845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8ba8b30d9347a3ac9272fee3d3ac67', 'request_id': 'req-8da46d31-04c3-4855-ba90-76599ecc5fd9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.884189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b2835b1c6c468498a06eb7d8a54197'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.894486 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 891/1769] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/users/89b2835b1c6c468498a06eb7d8a54197 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:40.899480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] The token cache is being invalidate because project ad8ba8b30d9347a3ac9272fee3d3ac67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:40.899480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.899480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:40.899960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.900862 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 879/1770] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/projects/ad8ba8b30d9347a3ac9272fee3d3ac67 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:40.904697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.905250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:40.906661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:40.989156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9120-b35e-407c-b3d3-1cb2563a76b4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.990168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46d31-04c3-4855-ba90-76599ecc5fd9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:40.994501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.995227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.995662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.996063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] PATH_INFO: `/v3/projects/2b15e62683244c7bbf1cfbcad289d009` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.996807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:40.997284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b15e62683244c7bbf1cfbcad289d009)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:40.997657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:40.998091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:40.998423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] PATH_INFO: `/v3/users/3e3a369473774e1b855a767bc695d782` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:40.999542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:40.999658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3a369473774e1b855a767bc695d782)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.001956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.086122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:41.087848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b15e62683244c7bbf1cfbcad289d009', 'request_id': 'req-73956b38-05fc-4460-93d1-a0fa2ee88936'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.089821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3a369473774e1b855a767bc695d782'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.103032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b15e62683244c7bbf1cfbcad289d009', 'request_id': 'req-73956b38-05fc-4460-93d1-a0fa2ee88936'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.118700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b15e62683244c7bbf1cfbcad289d009', 'request_id': 'req-73956b38-05fc-4460-93d1-a0fa2ee88936'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.119100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3a369473774e1b855a767bc695d782'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.140980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3a369473774e1b855a767bc695d782'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.142008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3a369473774e1b855a767bc695d782'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.142894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f1c90361-2f27-4c76-9fa2-bbe96b161940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3a369473774e1b855a767bc695d782'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.143669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] The token cache is being invalidate because project 2b15e62683244c7bbf1cfbcad289d009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:41.144125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.145832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-73956b38-05fc-4460-93d1-a0fa2ee88936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:41.148595 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 892/1771] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/projects/2b15e62683244c7bbf1cfbcad289d009 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:41.155392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.155870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.156252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.173475 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 880/1772] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:40 2022] DELETE /identity/v3/users/3e3a369473774e1b855a767bc695d782 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:41.184735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:41.186152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:41.212131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:41.274823 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 893/1773] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:41.284014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.284496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.285152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.322557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:41.323837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:41.339886 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 881/1774] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:41.341296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.356817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e655-e8b8-47b4-93ad-ac22ff1be0f3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.363671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.364704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.365374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.365803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.367245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:41.367788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.369878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.392111 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 894/1775] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:41.393498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.404418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08029ab4-111c-4ee2-becb-d616669ab769 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.410148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.411382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.423450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.423957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.424859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.427583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.493216 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 882/1776] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:41 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:41.497156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.510473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957c2b4-2f20-4c27-9ff4-e6adb0cbcdb5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.668287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.668920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.669216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.669641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.670441 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.672399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.711773 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 895/1777] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:41 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:41.715849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.728611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7e6e-0d84-4df1-8924-69bd35b0abdc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.735318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.736301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.736678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.737076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.738105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.741623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.773996 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 883/1778] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:41.778521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.794845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe574e9-1f37-4f56-a073-83f8eba6ae40 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.802070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.802845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.803353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.803791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.804561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.806308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e9fca-eb2b-43b0-90f4-bb92a6a1435a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.826567 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 896/1779] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:41.831315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.850915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdf3bf-5c86-49e3-b646-883a3729df93 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:41.857245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:41.858107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.858508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.859047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] PATH_INFO: `/v3/projects/6fd7810d45e144b6839673e24be743af/users/b331a97b38b84a9db8eed7fbf43ce1e3/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.887963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd7810d45e144b6839673e24be743af, user_id=b331a97b38b84a9db8eed7fbf43ce1e3, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:41.892829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:41.921526 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 884/1780] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:41 2022] PUT /identity/v3/projects/6fd7810d45e144b6839673e24be743af/users/b331a97b38b84a9db8eed7fbf43ce1e3/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:41.936016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:41.936555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:41.936733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:41.981682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] MFA Rules not processed for user `b331a97b38b84a9db8eed7fbf43ce1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:41.983083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:41.988003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:41.990170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.074684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341e331-40a7-4397-a8ee-22f5893a236b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.079681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.081164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.081522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.081898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] PATH_INFO: `/v3/projects/b7c37241f1764d0a8764db3896d58381` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.084267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c37241f1764d0a8764db3896d58381)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.086645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.090429 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 897/1781] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:42.095277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.108544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18cfdd-7ea0-47f1-ab88-dcf833619a00 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.114180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.115094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.115373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.115642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.116470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.118422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.143804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.157814 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 898/1782] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:42.159286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.161405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c37241f1764d0a8764db3896d58381', 'request_id': 'req-820de89f-a367-416e-8098-fee1ca49bc99'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.161909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.169311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c37241f1764d0a8764db3896d58381', 'request_id': 'req-820de89f-a367-416e-8098-fee1ca49bc99'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.173948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.180958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c37241f1764d0a8764db3896d58381', 'request_id': 'req-820de89f-a367-416e-8098-fee1ca49bc99'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.197380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] The token cache is being invalidate because project b7c37241f1764d0a8764db3896d58381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:42.197712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.198695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.201514 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 885/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:41 2022] DELETE /identity/v3/projects/b7c37241f1764d0a8764db3896d58381 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:42.202432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.211051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.271117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1cdd2-b75a-4ddf-930a-a2d85bf1ea23 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.278203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.278871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.279168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.279440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] PATH_INFO: `/v3/projects/dd05f82cba8143268ed338434c4a2bf3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.281229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd05f82cba8143268ed338434c4a2bf3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.301919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.371561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820de89f-a367-416e-8098-fee1ca49bc99 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.386026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd05f82cba8143268ed338434c4a2bf3', 'request_id': 'req-eaa71804-30c7-4e2f-a880-276ceda6b349'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.392518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd05f82cba8143268ed338434c4a2bf3', 'request_id': 'req-eaa71804-30c7-4e2f-a880-276ceda6b349'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.415835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd05f82cba8143268ed338434c4a2bf3', 'request_id': 'req-eaa71804-30c7-4e2f-a880-276ceda6b349'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.434807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] The token cache is being invalidate because project dd05f82cba8143268ed338434c4a2bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:42.435206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.435966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.442081 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 899/1784] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:42 2022] DELETE /identity/v3/projects/dd05f82cba8143268ed338434c4a2bf3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.443947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.445696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.454696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.455731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.456408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.456864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.458000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.460839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00dde4-f937-4195-bb0b-604bb55060d0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.490338 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 886/1785] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:42.492061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.492346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.492658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.516062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.517284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.526433 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 887/1786] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:42.527411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.529038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.543216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b9f6-5ca7-4643-878b-2d4915004195 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.549970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.550600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.551503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.551639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71804-30c7-4e2f-a880-276ceda6b349 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.551731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.551985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.553685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3f82-462b-4782-91ec-8306de74e5ae admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.560111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.560809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.561598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.561876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] PATH_INFO: `/v3/users/663951c00c304262b328434ea046e1d7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.563042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=663951c00c304262b328434ea046e1d7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.565453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.570507 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 888/1787] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:42.570507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.570507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.570507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.596932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.598346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.608443 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 889/1788] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:42.609374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.617959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.632096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d6cc2-f1e0-4fdd-921e-fa54837e1346 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.639075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.640220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.640552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.640757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] PATH_INFO: `/v3/projects/8d97c63febf543d4942bf42ae6108a5e/users/35d46e8aaa5242389e30c3c9cd0b20f5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.653160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663951c00c304262b328434ea046e1d7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.653970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663951c00c304262b328434ea046e1d7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.662071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d97c63febf543d4942bf42ae6108a5e, user_id=35d46e8aaa5242389e30c3c9cd0b20f5, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.665100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.666502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663951c00c304262b328434ea046e1d7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.675708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663951c00c304262b328434ea046e1d7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.686101 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 890/1789] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:42 2022] PUT /identity/v3/projects/8d97c63febf543d4942bf42ae6108a5e/users/35d46e8aaa5242389e30c3c9cd0b20f5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.686101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.688072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.696291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663951c00c304262b328434ea046e1d7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:42.713925 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 900/1790] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:42 2022] DELETE /identity/v3/users/663951c00c304262b328434ea046e1d7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.713925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.713925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.754535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.784595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79009-a96d-4e4b-ab9e-ac3bdf96ed52 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.800184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1d28-c1cb-40b5-9090-e6741b0306cb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.801952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.805123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.805123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.805123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.805123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:42.805123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.805495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.806252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.806599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.807021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.807264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.807721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.809420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.822634 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 891/1791] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:42.826415 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 901/1792] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:42.827125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.828687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.837744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127b60-20ff-41d5-a290-5490ee0b366d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.840408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2380-0f80-4d6e-8abb-c20c71b7c2ae admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.842800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.843521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.843685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.843962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.844750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.846311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.846663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.847029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.847314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.847617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] PATH_INFO: `/v3/projects/8d97c63febf543d4942bf42ae6108a5e/users/35d46e8aaa5242389e30c3c9cd0b20f5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.850128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d97c63febf543d4942bf42ae6108a5e, user_id=35d46e8aaa5242389e30c3c9cd0b20f5, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.853167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f90f13-7da7-41d7-84b8-95d119fd71b3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:42.865178 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 902/1793] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:42 2022] PUT /identity/v3/projects/8d97c63febf543d4942bf42ae6108a5e/users/35d46e8aaa5242389e30c3c9cd0b20f5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:42.875581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.877331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.877619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.883215 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 892/1794] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:09:42.887214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:42.917557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] MFA Rules not processed for user `35d46e8aaa5242389e30c3c9cd0b20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:42.918866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:42.984958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70eee-40e8-4fc4-93b4-caeb91df257d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:42.991106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:42.992047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:42.992392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:42.992722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:42.993386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:42.995267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.003580 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 903/1795] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:43.014065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.016260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.036424 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 893/1796] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:42 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:43.040488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.042982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.052227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4030-85f5-4914-bf45-94fc905156cf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.057678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.058567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.058909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.059241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.061480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.062762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.078347 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 894/1797] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:43.083243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.109010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5578f39-c29c-4e1d-b49c-78ca72d558a1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.115058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.115697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.115998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.116395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.117393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.119110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.135692 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4692-a668-4ef8-8677-cdda9514a2eb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.139166 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 895/1798] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:43.140392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.141360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.141819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.142089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.142352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.162913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.166863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.167499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0557d8-4f48-4643-97be-2e71df9816a2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.180457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.181611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.182071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.182555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] PATH_INFO: `/v3/projects/af831e6b68334c038f8fe58b01022859/users/ef29345da6d04a4182987a24d428fa56/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.191724 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 904/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:43.208043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af831e6b68334c038f8fe58b01022859, user_id=ef29345da6d04a4182987a24d428fa56, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.211386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03675610-c6ed-4529-80ab-503b01841b6a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.240474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.250739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.252135 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 896/1800] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:43 2022] PUT /identity/v3/projects/af831e6b68334c038f8fe58b01022859/users/ef29345da6d04a4182987a24d428fa56/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:43.255107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.255664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.256185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.268016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78de7-b0b6-4f6d-bbcd-d7a21b470334 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.303300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] MFA Rules not processed for user `ef29345da6d04a4182987a24d428fa56`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:43.304626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.436044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.449733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.450586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.450826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.452212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] PATH_INFO: `/v3/projects/840163a12e77420187474b48d26d3c95` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.453717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840163a12e77420187474b48d26d3c95)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.456963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.484059 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 897/1801] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:43.485249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.486975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.527280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840163a12e77420187474b48d26d3c95', 'request_id': 'req-142fb770-4dae-47e1-9bff-0f0db3325616'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:43.537094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840163a12e77420187474b48d26d3c95', 'request_id': 'req-142fb770-4dae-47e1-9bff-0f0db3325616'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:43.550956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840163a12e77420187474b48d26d3c95', 'request_id': 'req-142fb770-4dae-47e1-9bff-0f0db3325616'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:43.565482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] The token cache is being invalidate because project 840163a12e77420187474b48d26d3c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:43.565791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:43.566443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:43.573323 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 905/1802] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:43 2022] DELETE /identity/v3/projects/840163a12e77420187474b48d26d3c95 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:43.573323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.573323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.574272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30572de-6845-4428-ba9e-f43db3b9f82c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.626827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.627592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.627965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.628347 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.630942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.638297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.659189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fb770-4dae-47e1-9bff-0f0db3325616 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.667240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.668052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.668394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.669483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.670512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.675011 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5389383-f241-420a-84b5-82e6d9a4f1dc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.709078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.710492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.718025 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 906/1803] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:43 2022] POST /identity/v3/projects => generated 355 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:43.719771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33491f5-eaa6-4ce3-8345-0a2c96027dc0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.720103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33491f5-eaa6-4ce3-8345-0a2c96027dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.720376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33491f5-eaa6-4ce3-8345-0a2c96027dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.721758 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 898/1804] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:43.722934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.735896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e055-0058-41b8-b523-ee998bb1b09b service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.754142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e33491f5-eaa6-4ce3-8345-0a2c96027dc0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:43.756790 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e33491f5-eaa6-4ce3-8345-0a2c96027dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.814552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.836954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.840363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.840844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.841121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.842730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.848172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.875666 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 907/1805] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:43.883884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.884085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.884350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.898484 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 899/1806] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:43 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:43.902252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.921010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:43.923638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:43.930307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06227752-0c92-4472-8199-4e7500fa3330 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.938313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.939189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.939484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.939821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.941016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.944443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:43.965131 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 908/1807] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:43.966589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.970446 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 900/1808] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:43.983051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:43.986840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdea069-612e-418b-90ad-e665deec1511 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:43.993759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:43.994447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:43.994806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:43.995136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:43.995962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:43.996324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:43.998649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.003301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691f84-766d-40b1-822f-846f8cecf6bf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.011055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.011989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.012460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.013151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] PATH_INFO: `/v3/projects/d889438c4d884b30927f7be055e1ee28/users/b61b9b1eb63a4bb7bd7871c7961b3158/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.015759 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 909/1809] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:44.025958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.054484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691be6-3b33-429c-b9e4-10c7a67ce3d4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.057306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d889438c4d884b30927f7be055e1ee28, user_id=b61b9b1eb63a4bb7bd7871c7961b3158, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.060954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.064947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.066112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.067534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.068416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.069506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.072791 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.088203 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 901/1810] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:43 2022] PUT /identity/v3/projects/d889438c4d884b30927f7be055e1ee28/users/b61b9b1eb63a4bb7bd7871c7961b3158/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:44.089258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.132131 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 910/1811] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:44 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:44.136282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.246363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beebdf3-5973-4316-ae73-68ac3f25a4cb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.326674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c0f6-92b4-424c-b8a2-da40c5b0cea4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.348603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.352592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.353109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.353522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.355221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.360924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.397985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.399118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.399377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.399888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.400630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.402337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.420597 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 911/1812] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:44 2022] POST /identity/v3/users => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:44.424157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.432462 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 902/1813] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:44.437229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.444215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579df5e-c9e2-474e-a38b-affbc6f0f7a5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.454800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.457541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.457741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.457952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.459054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4500ba-fa9a-4705-9636-4fefeef072a9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.459812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.463215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.470212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.472314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.472524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.472865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] PATH_INFO: `/v3/projects/d889438c4d884b30927f7be055e1ee28/users/b61b9b1eb63a4bb7bd7871c7961b3158/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.477395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d889438c4d884b30927f7be055e1ee28, user_id=b61b9b1eb63a4bb7bd7871c7961b3158, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.486014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d578ac-13ae-48d5-8c5d-b15eb0d30c68 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.489525 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 912/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:44.493481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.509358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57446d-cd56-4cb7-9ea6-ccfb820f4537 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.512703 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 903/1815] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:44 2022] PUT /identity/v3/projects/d889438c4d884b30927f7be055e1ee28/users/b61b9b1eb63a4bb7bd7871c7961b3158/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:44.522142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:44.525395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.525624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.526111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.615028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] MFA Rules not processed for user `b61b9b1eb63a4bb7bd7871c7961b3158`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:44.617999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:44.690914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.693245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.693532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.693798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.693933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:44.694477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.697446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.738321 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 913/1816] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:44.739639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.763212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18541-02fc-4b72-a0e0-7cd5828ee961 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:44.775611 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 904/1817] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:44.775989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:44.776618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.776889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.777159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] PATH_INFO: `/v3/projects/8062a688b30f459e847e5c7cc0721216/users/5b90d615e4a5497fbc1eedb5b8dc369b/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.788316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:44.791423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:44.803382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8062a688b30f459e847e5c7cc0721216, user_id=5b90d615e4a5497fbc1eedb5b8dc369b, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:44.806720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14d587-7988-422f-87bb-238d8283fca1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:44.826377 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 914/1818] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:44 2022] PUT /identity/v3/projects/8062a688b30f459e847e5c7cc0721216/users/5b90d615e4a5497fbc1eedb5b8dc369b/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:44.840385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:44.840900 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:44.841279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:44.885338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] MFA Rules not processed for user `5b90d615e4a5497fbc1eedb5b8dc369b`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:44.886561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:44.924320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593cb7d-e47f-47dd-ae26-689e1909bd7c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.001503 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 915/1819] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:45.002832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.003474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.004203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.005027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.005797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.095893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d65120-5b52-49ff-8321-94a474c4e8fc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.100404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.103382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.103561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.103561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.103561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.103886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.104399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.106322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.115093 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 905/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:45.126585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:45.151978 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 916/1821] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:45 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:45.153557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.187461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad41d9-8e50-4bf9-a4aa-629fa2aa34cc service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.231126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.237019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:45.290130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.290952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.291345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.292090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.293088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.295129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.353145 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 906/1822] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:45 2022] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:45.357001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.378259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e5c35-8c70-4874-9317-ab6d3284b3f6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.389015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.389758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.389931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.390175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.393279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919120-2ea0-497c-9df6-62a458e7ae57 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.396396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:45.411527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.412263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.412534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.412798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.413447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.415054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.453497 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 907/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:45.462915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.491319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ed375-a68d-4b22-9942-f59a2234baed admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.510527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.511772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.515051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.515539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] PATH_INFO: `/v3/projects/c91cd56cc3b84000928a3fab2a2607f1/users/30a9a07a6cf9466c8890a77305463fd4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.579552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91cd56cc3b84000928a3fab2a2607f1, user_id=30a9a07a6cf9466c8890a77305463fd4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.590424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.636807 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 908/1824] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:45 2022] PUT /identity/v3/projects/c91cd56cc3b84000928a3fab2a2607f1/users/30a9a07a6cf9466c8890a77305463fd4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:45.638589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.647103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.651027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.689382 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 917/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:45.781826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ccd81-0f24-433f-a207-28fbeaf1ce32 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.797686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.800089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.801531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.802764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.804256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.806194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c212-e05f-48e0-bafd-d127f3c9de02 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.840222 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 909/1826] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:45.843832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:45.857916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f062e-a446-42ed-897e-cbbbeb40fbe1 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:45.874438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:45.876654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.877652 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.877929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] PATH_INFO: `/v3/projects/c91cd56cc3b84000928a3fab2a2607f1/users/30a9a07a6cf9466c8890a77305463fd4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:45.883182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91cd56cc3b84000928a3fab2a2607f1, user_id=30a9a07a6cf9466c8890a77305463fd4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:45.887214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:45.923645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 918/1827] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:45 2022] PUT /identity/v3/projects/c91cd56cc3b84000928a3fab2a2607f1/users/30a9a07a6cf9466c8890a77305463fd4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:45.937571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:45.937903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:45.938295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.001718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] MFA Rules not processed for user `30a9a07a6cf9466c8890a77305463fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:46.002848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:46.168721 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 910/1828] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:46.181450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:46.183408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:46.370237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85d03-16cb-4aba-ae9a-2306dfcd1d4d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:46.376344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:46.377992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:46.378294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:46.379341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.409989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:46.413074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fc832-e43b-4596-91f1-253e216c0274 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:46.439950 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 919/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:46.590685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:46.598165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:46.602265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe843ae9-7d56-437f-99c0-3a47348389e1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:46.608343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:46.609170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:46.609612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:46.610741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.700505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:46.701922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51466-1c10-469f-9388-11c091760791 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:46.702197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51466-1c10-469f-9388-11c091760791 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:46.702486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51466-1c10-469f-9388-11c091760791 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.704938 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 920/1830] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:09:46.706490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:46.722326 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 911/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:46.740224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443258af-9455-417d-a68b-dc755d55b278 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:46.740602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443258af-9455-417d-a68b-dc755d55b278 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:46.740988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443258af-9455-417d-a68b-dc755d55b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:46.780042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-443258af-9455-417d-a68b-dc755d55b278 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:46.785930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-443258af-9455-417d-a68b-dc755d55b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:46.870044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:46.965243 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 921/1832] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:47.498506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:47.500007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:47.530852 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023b8d-4f76-4aa2-8f0c-11043c6de201 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:47.539608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:47.540282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:47.540563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:47.540836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:47.564229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:47.565936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6f776-2d95-4ade-956d-de01de6dfa2d service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:47.596069 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 912/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:48.510002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443258af-9455-417d-a68b-dc755d55b278 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:48.511691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-443258af-9455-417d-a68b-dc755d55b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:48.698144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443258af-9455-417d-a68b-dc755d55b278 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:48.710507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:48.711262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:48.711542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:48.711845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] PATH_INFO: `/v3/users/b331a97b38b84a9db8eed7fbf43ce1e3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:48.713364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b331a97b38b84a9db8eed7fbf43ce1e3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:48.715647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:48.831407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b331a97b38b84a9db8eed7fbf43ce1e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:48.833004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b331a97b38b84a9db8eed7fbf43ce1e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:48.841632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b331a97b38b84a9db8eed7fbf43ce1e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:48.853805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b331a97b38b84a9db8eed7fbf43ce1e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:48.867313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b331a97b38b84a9db8eed7fbf43ce1e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:48.879162 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 922/1834] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:48 2022] DELETE /identity/v3/users/b331a97b38b84a9db8eed7fbf43ce1e3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:48.881098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:48.881783 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:48.882556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:48.921997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:48.924152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:49.037666 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 913/1835] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:49.073486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:49.074929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:49.228824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb075-8f1e-4e38-99aa-4099547ce30b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:49.233111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:49.233714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:49.234016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:49.234284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:49.241443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:49.248724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:49.250299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:49.262997 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 923/1836] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:49.555554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:49.557849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:49.593784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73a06-8221-4150-a1dc-0c13c3608a7a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:49.600538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:49.601426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:49.601707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:49.601977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] PATH_INFO: `/v3/projects/6fd7810d45e144b6839673e24be743af` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:49.603124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd7810d45e144b6839673e24be743af)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:49.605825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:49.657934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd7810d45e144b6839673e24be743af', 'request_id': 'req-32b7d011-0e4e-4619-9cc3-e89160b8e8be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.664940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd7810d45e144b6839673e24be743af', 'request_id': 'req-32b7d011-0e4e-4619-9cc3-e89160b8e8be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.674478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd7810d45e144b6839673e24be743af', 'request_id': 'req-32b7d011-0e4e-4619-9cc3-e89160b8e8be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.686162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] The token cache is being invalidate because project 6fd7810d45e144b6839673e24be743af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:49.686461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.687127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.688677 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 914/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:49 2022] DELETE /identity/v3/projects/6fd7810d45e144b6839673e24be743af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:49.693336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:49.704287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c55cb-ac6b-4903-8d48-03d94ab91123 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:49.774449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:49.775096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:49.775375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:49.775648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] PATH_INFO: `/v3/users/35d46e8aaa5242389e30c3c9cd0b20f5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:49.776849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d46e8aaa5242389e30c3c9cd0b20f5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:49.778858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:49.830928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d46e8aaa5242389e30c3c9cd0b20f5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.831594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d46e8aaa5242389e30c3c9cd0b20f5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.842034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d46e8aaa5242389e30c3c9cd0b20f5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.850794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d46e8aaa5242389e30c3c9cd0b20f5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.863423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0ad05507-beb1-4e68-889e-a1ac7eadcabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d46e8aaa5242389e30c3c9cd0b20f5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:49.869911 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 924/1838] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:49 2022] DELETE /identity/v3/users/35d46e8aaa5242389e30c3c9cd0b20f5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:50.348929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.350582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:50.387674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d011-0e4e-4619-9cc3-e89160b8e8be admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.399693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:50.471764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.472988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.473325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.473599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] PATH_INFO: `/v3/projects/8d97c63febf543d4942bf42ae6108a5e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.474807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d97c63febf543d4942bf42ae6108a5e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.476765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.535091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d97c63febf543d4942bf42ae6108a5e', 'request_id': 'req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.542890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d97c63febf543d4942bf42ae6108a5e', 'request_id': 'req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.552598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d97c63febf543d4942bf42ae6108a5e', 'request_id': 'req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.565275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] The token cache is being invalidate because project 8d97c63febf543d4942bf42ae6108a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:50.565565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.566250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6abfc504-0ed2-4dbb-aaa1-283e2e0cc46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:50.567771 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 915/1839] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:50 2022] DELETE /identity/v3/projects/8d97c63febf543d4942bf42ae6108a5e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:50.572622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.572997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.573178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.596093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:50.597323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:50.665011 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 925/1840] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:50.677449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.677737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.678016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.701276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:50.702940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:50.711477 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 916/1841] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:50.715689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.726193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bbbec-dca5-421e-9a21-2b31c41c360c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.732806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.733505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.733851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.734244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.734979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:50.735346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.737929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.750260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:50.754250 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 926/1842] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:09:50.758921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.768603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14dbc1-cacb-4f5a-ad82-2ac3f9bb6e98 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.773714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.774370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.774645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.774921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.775637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.777679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.817065 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 917/1843] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:50 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:50.821156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.832485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579e520-4b0f-40e1-8c54-d4cbd90c9407 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.887292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.887940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.888211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.888484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.889105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.891012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.913472 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 927/1844] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:50 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:50.917941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.930203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13a3a-5afd-460f-9166-9585b69043e4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.939994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.940527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.940841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.941921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.942607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.944267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.955279 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 918/1845] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:50.959439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:50.969698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fd4e-e2b7-4074-866b-27a4a7e30438 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:50.975386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:50.976050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:50.976327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:50.976598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:50.977264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:50.978909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ef51-3634-41c5-a668-76dee412d3a2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:50.992665 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 928/1846] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:50.997087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.008099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88122f7-7845-4ac6-9f21-aba66c21b1a5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.014191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.014845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.015121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.015392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] PATH_INFO: `/v3/projects/780b916cea104efba917d87af446ac77/users/8b99ff04dd904a78b4db1647f086a5c4/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.032034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=780b916cea104efba917d87af446ac77, user_id=8b99ff04dd904a78b4db1647f086a5c4, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.034668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.050695 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 919/1847] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:50 2022] PUT /identity/v3/projects/780b916cea104efba917d87af446ac77/users/8b99ff04dd904a78b4db1647f086a5c4/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:51.063081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.063384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.063653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.094904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] MFA Rules not processed for user `8b99ff04dd904a78b4db1647f086a5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:51.096332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:51.173854 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 929/1848] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:51.178540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.241095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:51.300333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fac7-61a6-40c7-8903-45f9c5a93f5c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.306897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.307619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.307991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.308324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.309336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.316778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.347178 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 920/1849] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:51 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:51.351345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.363890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36c635-3201-4667-a03b-f68dbd0ce774 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.365283 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.367277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:51.446357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.447071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84775-f593-4085-9806-2124153b0091 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.447538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.448163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.448831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.452061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.452593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.452771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.453049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.453316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] PATH_INFO: `/v3/users/5b90d615e4a5497fbc1eedb5b8dc369b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.454550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b90d615e4a5497fbc1eedb5b8dc369b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.455391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.456732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.475532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:51.485143 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 930/1850] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:51 2022] POST /identity/v3/users => generated 310 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:51.490562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.501663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef6cf-4ad5-485a-9a74-a7d29e5b5d72 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.507933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.508606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.508883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.509114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.509840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.511489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.525790 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 931/1851] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:51.530984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.543815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b90d615e4a5497fbc1eedb5b8dc369b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.549527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d60630-d35e-42f2-b32a-cacadcbfe3ad admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.558023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.558248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.558449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.558718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] PATH_INFO: `/v3/projects/ac14377990cd4b4cb9081841e8b92fc4/users/d41831daec9548f1af74d60079196372/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.562962 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b90d615e4a5497fbc1eedb5b8dc369b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.581818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac14377990cd4b4cb9081841e8b92fc4, user_id=d41831daec9548f1af74d60079196372, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.585044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.593991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b90d615e4a5497fbc1eedb5b8dc369b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.595133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b90d615e4a5497fbc1eedb5b8dc369b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.596733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2f405fb-3925-48f8-965d-018d6459b691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b90d615e4a5497fbc1eedb5b8dc369b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:51.610126 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 932/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:51 2022] PUT /identity/v3/projects/ac14377990cd4b4cb9081841e8b92fc4/users/d41831daec9548f1af74d60079196372/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:51.614324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.616035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:51.620122 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 921/1853] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:51 2022] DELETE /identity/v3/users/5b90d615e4a5497fbc1eedb5b8dc369b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:51.624708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.625067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.625409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.655469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:51.657865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:51.715927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:51.727401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e9b3-174a-41ca-84fa-da1566e21c73 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.775286 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 922/1854] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:51.806642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.808297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.808297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.809508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.809869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.811893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.835368 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 933/1855] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:51.837026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.848203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921215-d39e-484d-9db1-4525f4273c8f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:51.876714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:51.881686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.882287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.882756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] PATH_INFO: `/v3/projects/ac14377990cd4b4cb9081841e8b92fc4/users/d41831daec9548f1af74d60079196372/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:51.896684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac14377990cd4b4cb9081841e8b92fc4, user_id=d41831daec9548f1af74d60079196372, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:51.897629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:51.899834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:51.907472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2af97-b29a-43ec-aca8-cf020c3f087e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:51.943337 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 923/1856] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:51 2022] PUT /identity/v3/projects/ac14377990cd4b4cb9081841e8b92fc4/users/d41831daec9548f1af74d60079196372/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:51.953178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:51.953316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:51.953588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.014547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] MFA Rules not processed for user `d41831daec9548f1af74d60079196372`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:52.015829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.071072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33647bb-da38-4dc7-9129-741d7904c49a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.116586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:52.178016 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 924/1857] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:52.191697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.193685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.196643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.197438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.197883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.198306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.287767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734972a-b6ea-4756-a800-f6a199f2007b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.294694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.295688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.296349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.296790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.334796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.336076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.345515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.348064 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 925/1858] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:52.359475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.381050 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 934/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:52.576339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.586112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e014-4f55-477a-a805-962ecef35c52 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.595097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.596037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.596492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.596733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.600345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.685810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.687296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:52.694160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:52.702153 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 926/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:52.914658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:52.922611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:52.940631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637d6a-29e1-48ee-b502-56c31abb3d05 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:52.966309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:52.968091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:52.968391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:52.971527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] PATH_INFO: `/v3/projects/8062a688b30f459e847e5c7cc0721216` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:52.974984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8062a688b30f459e847e5c7cc0721216)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:52.979238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.055212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8062a688b30f459e847e5c7cc0721216', 'request_id': 'req-59e65165-6ce4-432f-8c20-0cdd00363ebe'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.062519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8062a688b30f459e847e5c7cc0721216', 'request_id': 'req-59e65165-6ce4-432f-8c20-0cdd00363ebe'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.079863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8062a688b30f459e847e5c7cc0721216', 'request_id': 'req-59e65165-6ce4-432f-8c20-0cdd00363ebe'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.090642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] The token cache is being invalidate because project 8062a688b30f459e847e5c7cc0721216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:53.090953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.091693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.093927 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 935/1861] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:52 2022] DELETE /identity/v3/projects/8062a688b30f459e847e5c7cc0721216 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:53.098389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.116074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f84a4-053e-433a-afc7-54fa289511eb service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.190639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.191685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.192083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.192417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] PATH_INFO: `/v3/users/30a9a07a6cf9466c8890a77305463fd4` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.193737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a9a07a6cf9466c8890a77305463fd4)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.195759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.263953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a9a07a6cf9466c8890a77305463fd4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.279568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a9a07a6cf9466c8890a77305463fd4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.288901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a9a07a6cf9466c8890a77305463fd4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.289657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a9a07a6cf9466c8890a77305463fd4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.291827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-48d96c41-0895-48bf-b5c4-5f4ac283f339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a9a07a6cf9466c8890a77305463fd4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.306908 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 927/1862] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:53 2022] DELETE /identity/v3/users/30a9a07a6cf9466c8890a77305463fd4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:53.649936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:53.651591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:53.667983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e65165-6ce4-432f-8c20-0cdd00363ebe admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:53.747929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:53.759884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:53.760797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.761360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.761935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] PATH_INFO: `/v3/projects/c91cd56cc3b84000928a3fab2a2607f1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.763922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91cd56cc3b84000928a3fab2a2607f1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:53.766360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:53.835339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91cd56cc3b84000928a3fab2a2607f1', 'request_id': 'req-43c549f1-2f48-40a4-8e14-2b82f14e1a75'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.843624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91cd56cc3b84000928a3fab2a2607f1', 'request_id': 'req-43c549f1-2f48-40a4-8e14-2b82f14e1a75'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.854970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91cd56cc3b84000928a3fab2a2607f1', 'request_id': 'req-43c549f1-2f48-40a4-8e14-2b82f14e1a75'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.869434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] The token cache is being invalidate because project c91cd56cc3b84000928a3fab2a2607f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:53.872148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.872951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43c549f1-2f48-40a4-8e14-2b82f14e1a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:53.874751 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 936/1863] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:53 2022] DELETE /identity/v3/projects/c91cd56cc3b84000928a3fab2a2607f1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:53.879624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.880566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.880998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.901553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:53.902759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:53.967445 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 928/1864] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:53.975109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:53.975607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:53.975715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:53.997671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:53.999010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:54.010786 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 937/1865] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:54.012179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.022633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fe33f-16a4-4c7a-b79a-3b22b60ad6ec None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.028671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.029351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.029637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.029913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.030884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:09:54.030884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.032799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.050722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.051812 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 929/1866] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:09:54.061158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783ab9d-8b8b-4fc3-a884-bbf9dda2f7b5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.066405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.067083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.067361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.067640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.068322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.070253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.103711 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 938/1867] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:54.108145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.115299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:54.119496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11e73-2f00-4d1b-83bf-a76d98781a63 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.228672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.229550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.229977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.230397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.231196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.233694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.260816 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 930/1868] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:54 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:54.264785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.276055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71104d87-8cd8-4784-ba29-d3e645aaaeca admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.281474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.282092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.282372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.282641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.283619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.284997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.301801 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 939/1869] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:54.306092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.318563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd767-b4be-4169-9645-39f3a7fa4950 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.324235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.325027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.325311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.325586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.326279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.327927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108079f-f364-4ad5-9e82-00e2c27c26df admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.341070 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 931/1870] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:54.345526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.361656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44cd7-77ad-4359-afc3-6ba49adbd0d4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.377913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.379015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.379473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.379855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] PATH_INFO: `/v3/projects/45cf8698101d4f9a97027bf163609593/users/bdaa5eb435cc479784e16f27cb5c37f6/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.408578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cf8698101d4f9a97027bf163609593, user_id=bdaa5eb435cc479784e16f27cb5c37f6, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.416008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.446270 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 940/1871] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:54 2022] PUT /identity/v3/projects/45cf8698101d4f9a97027bf163609593/users/bdaa5eb435cc479784e16f27cb5c37f6/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:54.461330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.462332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.462693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.500895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] MFA Rules not processed for user `bdaa5eb435cc479784e16f27cb5c37f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:54.502155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:54.596578 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 932/1872] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:54.598081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.670618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b3e9-a87c-4c23-86a9-5f160642cd8f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.675327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.676054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.676328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.676593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.678580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.679285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.715616 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 941/1873] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:09:54 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:54.716897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.729667 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e757-7c76-409c-ae03-37cfd48319eb None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.807004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.807652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.808133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.808505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.809159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.811210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.856167 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 933/1874] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:09:54 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:09:54.859909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.873611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe45b-2031-41e3-a7ca-c0413ed78a11 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.879088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.884102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.884448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.884738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.885470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.887149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:54.894620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:54.928026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:54.928691 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 942/1875] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:09:54.934553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:54.945796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1120-726b-44ba-a9cd-86cf1cbcedcd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:54.952719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:54.953589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:54.953880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:54.954261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] PATH_INFO: `/v3/projects/2a2302fea4a045a6a42d0aa723f94696/users/2ee31bdc007d44af92520b28552e152f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:54.980163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2302fea4a045a6a42d0aa723f94696, user_id=2ee31bdc007d44af92520b28552e152f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:54.991257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:55.065191 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 934/1876] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:54 2022] PUT /identity/v3/projects/2a2302fea4a045a6a42d0aa723f94696/users/2ee31bdc007d44af92520b28552e152f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:09:55.071525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:55.092906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111525-ff6f-40e9-8570-64cec3e5cfa5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:55.285879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:55.286671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.287049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.287413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.288207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:55.291007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cead5d-ed5b-4c54-a175-c5ed9ad3b551 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:55.314108 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 943/1877] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:09:55.318610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:55.341677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2db20-b8fd-4723-b6c2-fc2b68e334d3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:55.361879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:55.362596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.362876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.363199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] PATH_INFO: `/v3/projects/2a2302fea4a045a6a42d0aa723f94696/users/2ee31bdc007d44af92520b28552e152f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.366814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2302fea4a045a6a42d0aa723f94696, user_id=2ee31bdc007d44af92520b28552e152f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:55.371028 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:55.400044 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 935/1878] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:09:55 2022] PUT /identity/v3/projects/2a2302fea4a045a6a42d0aa723f94696/users/2ee31bdc007d44af92520b28552e152f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:55.410833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.411116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.411409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.486813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] MFA Rules not processed for user `2ee31bdc007d44af92520b28552e152f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:55.488501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:55.675486 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 944/1879] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:55.684809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:55.695594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:55.772873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6263b-7152-4dc8-b77c-3610590d584c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:55.777928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:55.778522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:55.778804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:55.779536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:55.874005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:55.875806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2b7d-0776-4999-8936-9034a7b8d11c service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:55.891881 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 936/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:58.460975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.463734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.534701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e24e33-5e22-450e-b003-60b74f8fe22f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.543081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.544270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.544729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.545626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] PATH_INFO: `/v3/users/8b99ff04dd904a78b4db1647f086a5c4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.547232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b99ff04dd904a78b4db1647f086a5c4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.550029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.581220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:58.625106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b99ff04dd904a78b4db1647f086a5c4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.626076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b99ff04dd904a78b4db1647f086a5c4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.636174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b99ff04dd904a78b4db1647f086a5c4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.644238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b99ff04dd904a78b4db1647f086a5c4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.660804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b99ff04dd904a78b4db1647f086a5c4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.668240 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 945/1881] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:58 2022] DELETE /identity/v3/users/8b99ff04dd904a78b4db1647f086a5c4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:58.672987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.673475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.673682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.693683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:58.694588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.767725 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 937/1882] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:58.781109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.783153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.839129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:58.840795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:58.848102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2737-66ff-43bd-9b6a-76241ff7e34a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.852160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.852759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.853030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.853294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.853426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb3bbd-6196-48f9-91ac-b457a6874cb6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:58.860498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:58.861140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.861422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.861685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] PATH_INFO: `/v3/users/bdaa5eb435cc479784e16f27cb5c37f6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:58.863017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaa5eb435cc479784e16f27cb5c37f6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.864682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:58.865287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.866177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5a1ba-d0c2-4eb1-be88-9f420e81991f service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:58.876657 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 946/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:58.879895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:58.917856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaa5eb435cc479784e16f27cb5c37f6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.932823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaa5eb435cc479784e16f27cb5c37f6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.952382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaa5eb435cc479784e16f27cb5c37f6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.953754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaa5eb435cc479784e16f27cb5c37f6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.954073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaa5eb435cc479784e16f27cb5c37f6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:58.976818 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 938/1884] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:58 2022] DELETE /identity/v3/users/bdaa5eb435cc479784e16f27cb5c37f6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:58.981090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:58.981377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:58.981648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.003006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:59.004560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.077042 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 947/1885] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:09:59.088387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:59.089810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.169331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05896c0f-cbba-4fe0-a469-bff2bed0e457 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:59.174292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:59.175039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:59.175577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:59.175895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.186243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:59.187689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:59.198884 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 939/1886] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:59.843717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:59.846606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.864287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935937-7e0a-48c4-843a-27aabaa714f9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:59.870479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:59.871427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:59.871802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:59.872308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] PATH_INFO: `/v3/projects/780b916cea104efba917d87af446ac77` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:59.876146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780b916cea104efba917d87af446ac77)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:59.878891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:59.929848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:59.939305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:59.941295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:59.941906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780b916cea104efba917d87af446ac77', 'request_id': 'req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:59.949792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780b916cea104efba917d87af446ac77', 'request_id': 'req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:59.956124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f27f1-93ed-4adf-8ae0-982805723911 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:59.962210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780b916cea104efba917d87af446ac77', 'request_id': 'req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:59.980551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] The token cache is being invalidate because project 780b916cea104efba917d87af446ac77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:09:59.980837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:59.981486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:09:59.983000 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 948/1887] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:59 2022] DELETE /identity/v3/projects/780b916cea104efba917d87af446ac77 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:09:59.986864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:59.989027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.020755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.021416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.021694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.021965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] PATH_INFO: `/v3/projects/45cf8698101d4f9a97027bf163609593` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.023114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cf8698101d4f9a97027bf163609593)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.025061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.056388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869d0b4-ee50-4858-9cb4-9117f1cd98b9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:00.061265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.061708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.061990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.062262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] PATH_INFO: `/v3/users/d41831daec9548f1af74d60079196372` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.063384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41831daec9548f1af74d60079196372)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.064646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:00.065429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.075395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cf8698101d4f9a97027bf163609593', 'request_id': 'req-35a830f2-cbab-4b32-b144-7fdc4aefeeda'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.081978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cf8698101d4f9a97027bf163609593', 'request_id': 'req-35a830f2-cbab-4b32-b144-7fdc4aefeeda'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.089954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cf8698101d4f9a97027bf163609593', 'request_id': 'req-35a830f2-cbab-4b32-b144-7fdc4aefeeda'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.101686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] The token cache is being invalidate because project 45cf8698101d4f9a97027bf163609593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:00.101968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.102609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.104164 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 940/1888] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:09:59 2022] DELETE /identity/v3/projects/45cf8698101d4f9a97027bf163609593 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:00.108193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:00.109595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.115497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41831daec9548f1af74d60079196372'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.116195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41831daec9548f1af74d60079196372'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.124889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41831daec9548f1af74d60079196372'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.132175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41831daec9548f1af74d60079196372'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.145536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41831daec9548f1af74d60079196372'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.151093 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 949/1889] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:09:59 2022] DELETE /identity/v3/users/d41831daec9548f1af74d60079196372 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:00.176410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a830f2-cbab-4b32-b144-7fdc4aefeeda admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:00.246246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.246901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.247186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.247459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] PATH_INFO: `/v3/users/2ee31bdc007d44af92520b28552e152f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.248687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee31bdc007d44af92520b28552e152f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.250765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.317991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee31bdc007d44af92520b28552e152f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.332705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee31bdc007d44af92520b28552e152f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.342924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee31bdc007d44af92520b28552e152f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.343836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee31bdc007d44af92520b28552e152f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.344705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-63b08604-0ec7-41ac-bd01-e3244c72fb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee31bdc007d44af92520b28552e152f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.348119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:00.360123 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 941/1890] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:00 2022] DELETE /identity/v3/users/2ee31bdc007d44af92520b28552e152f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:00.460014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:00.461197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.475537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7274c-ec30-47f3-bc1d-1634bc88c474 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:00.526582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:00.546551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.547201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.547481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.547844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] PATH_INFO: `/v3/projects/ac14377990cd4b4cb9081841e8b92fc4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.548949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac14377990cd4b4cb9081841e8b92fc4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.551150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.630471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac14377990cd4b4cb9081841e8b92fc4', 'request_id': 'req-8b2fdd15-a12a-4a08-ad72-f68793ce99af'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.637830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac14377990cd4b4cb9081841e8b92fc4', 'request_id': 'req-8b2fdd15-a12a-4a08-ad72-f68793ce99af'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.650179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac14377990cd4b4cb9081841e8b92fc4', 'request_id': 'req-8b2fdd15-a12a-4a08-ad72-f68793ce99af'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.665805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] The token cache is being invalidate because project ac14377990cd4b4cb9081841e8b92fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:00.666135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.666765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8b2fdd15-a12a-4a08-ad72-f68793ce99af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:00.669294 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 950/1891] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:00 2022] DELETE /identity/v3/projects/ac14377990cd4b4cb9081841e8b92fc4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:00.677065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.677586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.679304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.703608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:00.705742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.800080 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 942/1892] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:00.801674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.802285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.802285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.853800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:00.855909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.873155 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 951/1893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:00.873332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:00.888504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0983ee-d373-47d6-903a-124153ff0d78 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:00.896839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.897903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.898457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.898930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.899892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:00.900483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.902480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.923054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:00.935771 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 943/1894] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:10:00.938402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b45e49-56de-49d6-99c6-f9d1ad6a9991 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:00.947171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:00.948248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.948801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.949288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.950549 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:00.953471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:00.974248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:00.977413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:01.006397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4b0e9-82d6-496f-ab39-2ba6660ee441 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.022235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.032133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.032678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.038465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] PATH_INFO: `/v3/projects/2a2302fea4a045a6a42d0aa723f94696` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.039220 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 952/1895] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:00 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:01.052360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.052807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2302fea4a045a6a42d0aa723f94696)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.056331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.143320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0baa8b-9fec-4404-9cbe-ed8c9b873d26 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.152075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.153060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.153450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.154045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.154784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.157327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.195045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2302fea4a045a6a42d0aa723f94696', 'request_id': 'req-f81be4e2-49c5-4357-be11-66f647e8a471'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:01.196404 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 953/1896] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:01.204105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.208811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2302fea4a045a6a42d0aa723f94696', 'request_id': 'req-f81be4e2-49c5-4357-be11-66f647e8a471'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:01.222929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2302fea4a045a6a42d0aa723f94696', 'request_id': 'req-f81be4e2-49c5-4357-be11-66f647e8a471'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:01.226997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd638-9f20-4af9-90e7-f6caae3d733c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.251069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] The token cache is being invalidate because project 2a2302fea4a045a6a42d0aa723f94696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:01.251607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:01.253818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f81be4e2-49c5-4357-be11-66f647e8a471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:01.256705 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 944/1897] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:00 2022] DELETE /identity/v3/projects/2a2302fea4a045a6a42d0aa723f94696 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:01.261454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c9df7-16bd-4e03-8c04-389584fa143e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.261734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c9df7-16bd-4e03-8c04-389584fa143e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.262002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c9df7-16bd-4e03-8c04-389584fa143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.270904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:01.289280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b61c9df7-16bd-4e03-8c04-389584fa143e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:01.293594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b61c9df7-16bd-4e03-8c04-389584fa143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:01.317556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.319068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.319527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.320470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.321325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.324415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.343435 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 954/1898] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:01.344641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.346755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:01.362815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542519-3305-4e64-a5f0-46d0cf75c237 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.370655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.371767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.372894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.373627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.374622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.377951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.396382 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 955/1899] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:01.397533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.402945 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 945/1900] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:01.409239 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3494-7c9b-4a94-85c0-1ae2165f5c1d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.413337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.413615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.414208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.417012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.417863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.418299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.418919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] PATH_INFO: `/v3/projects/2abdc9abd2da4b5d857a5fa1211264da/users/ea360cd3ce3b482c945766269ab4a315/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.423513 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:01.444666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:01.446054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:01.462448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abdc9abd2da4b5d857a5fa1211264da, user_id=ea360cd3ce3b482c945766269ab4a315, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.466949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a58d-26ae-4333-8634-33b92cbc29f9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.467354 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 946/1901] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:01.468428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.479603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d154-d3b3-44f0-91ae-dfe07584cb97 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.491947 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 956/1902] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:01 2022] PUT /identity/v3/projects/2abdc9abd2da4b5d857a5fa1211264da/users/ea360cd3ce3b482c945766269ab4a315/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:01.499877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.500187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.501650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.531904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] MFA Rules not processed for user `ea360cd3ce3b482c945766269ab4a315`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:01.533064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:01.555200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.556008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.556386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.556828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.557583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:01.558010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.560213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.579586 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 947/1903] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:01.580805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.612530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df31d-6946-4d31-ad80-871910b1d57a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.624274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.625183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.625560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.626643 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.627457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.633053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.667408 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 957/1904] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:01.687792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.706336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df7f0-2ef5-49df-88a5-2d26fb9b4117 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.712190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.712980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.713291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.713677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.714496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.717677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.718705 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 948/1905] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:01.723427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.759319 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 958/1906] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:01.763141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:01.833400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d110-f2de-48de-91d2-29c05165cee7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.936743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449967d-c480-456a-911f-7fe8d1345e60 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:01.947995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.948628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.949049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.949369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.950163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.952509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.960909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:01.962694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:01.962982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:01.963257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:01.964247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:01.965075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:01.969746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:01.995426 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 959/1907] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:02.000817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.004517 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 949/1908] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:01 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:02.007777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.022289 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:02.027427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0c6-121d-403c-8584-ae28f5c48e6c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.036893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96dd4d-61d8-4243-b67d-3a700c829f9d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.042112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.043589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.044229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.044506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.045826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.048099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.062047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.062786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.063009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.063319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.066409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.073853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.086433 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 960/1909] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:02.090490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.093444 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 950/1910] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:02.097483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.106933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ace9-3cec-42a3-bf71-4adbe6f158ba admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.108312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f21182-1c03-4aa3-babb-cff5a58f2e9a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.112951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.113566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.113852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.115711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.115711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.116498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.116650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.117402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.117777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.118171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.119119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.120868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.128280 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 961/1911] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:02.132606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.134867 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 951/1912] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:02.138756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.147811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648ae5-645b-4289-bf01-455497c8cb9e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.152445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139ef12-5fd0-410d-a583-920ceb4eb073 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.157055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.157725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.157998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.158268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] PATH_INFO: `/v3/projects/f0f5df3e46e5481e99a5e7f45270ddd4/users/146e6606ccd2423786873eac44444a95/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.161809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.162473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.162747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.163056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] PATH_INFO: `/v3/projects/4489da72cb074a49987c31e9ee8aa5c2/users/1a36fbae16574438831f53355ba99190/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.182388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4489da72cb074a49987c31e9ee8aa5c2, user_id=1a36fbae16574438831f53355ba99190, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.182856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f5df3e46e5481e99a5e7f45270ddd4, user_id=146e6606ccd2423786873eac44444a95, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.185059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25b621-8c8b-4a12-97cf-bdd504755f8e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.185807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f3a4b-4d3f-42b8-8ca7-29b413afb682 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.201293 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 952/1913] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:02 2022] PUT /identity/v3/projects/4489da72cb074a49987c31e9ee8aa5c2/users/1a36fbae16574438831f53355ba99190/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:02.213054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.213635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.214310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.216847 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 962/1914] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:02 2022] PUT /identity/v3/projects/f0f5df3e46e5481e99a5e7f45270ddd4/users/146e6606ccd2423786873eac44444a95/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:02.228122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.228439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.228653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.247707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] MFA Rules not processed for user `1a36fbae16574438831f53355ba99190`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:02.249158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:02.261747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] MFA Rules not processed for user `146e6606ccd2423786873eac44444a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:02.262961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:02.327789 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 953/1915] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:02.338581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.340060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:02.352236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 963/1916] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:02.353335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.422952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372520dd-f7f6-45b3-b179-9deb5d3c1365 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.430796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe304-e81b-430e-a20d-fd186b23ac3b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.440354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.441053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.441313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.441594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.441925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.442243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.443026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.443441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.443888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.444504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.467994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.469592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.496952 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 954/1917] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:02.507573 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 964/1918] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:02 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:02.511632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.528228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab76d-7ac4-40ee-b0ec-d4a9a9dfde74 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.601055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:02.615319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.616451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.617141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.617927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.618940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.621794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.679135 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 955/1919] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:02 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:02.683472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.698440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d6f9-4471-4acd-a99e-a93c9a2690eb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.721250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.721891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.722205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.722477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.723134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.724824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.756113 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 965/1920] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:02.761565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.773937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9887d-915e-4aa8-be2d-568e4a9569c6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.783437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.785669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.786948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.787435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] PATH_INFO: `/v3/projects/875e360390904ad7a6e9f250dece9369/users/f126dc1e5a5f4e589803980771c99990/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.811841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=875e360390904ad7a6e9f250dece9369, user_id=f126dc1e5a5f4e589803980771c99990, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.816412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.843457 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 956/1921] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:02 2022] PUT /identity/v3/projects/875e360390904ad7a6e9f250dece9369/users/f126dc1e5a5f4e589803980771c99990/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:02.847720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.861953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefca6-4db5-4ca7-b1ad-fb2cf2a49a95 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.873171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:02.988625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.989312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.990044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.990044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.990511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.993676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6957-f7a4-4c6d-bea2-1caa261de8a9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.017758 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 966/1922] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:03.037535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:03.053922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943a91-a52e-480c-8df2-d1ec296f7e9c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:03.071268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:03.072326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.072670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.073005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] PATH_INFO: `/v3/projects/875e360390904ad7a6e9f250dece9369/users/f126dc1e5a5f4e589803980771c99990/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.077931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875e360390904ad7a6e9f250dece9369, user_id=f126dc1e5a5f4e589803980771c99990, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:03.081263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.113474 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 957/1923] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:03 2022] PUT /identity/v3/projects/875e360390904ad7a6e9f250dece9369/users/f126dc1e5a5f4e589803980771c99990/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:03.127178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafab43-2da0-4062-a752-011289144da7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.127944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafab43-2da0-4062-a752-011289144da7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.128215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafab43-2da0-4062-a752-011289144da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.187153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6aafab43-2da0-4062-a752-011289144da7 None None] MFA Rules not processed for user `f126dc1e5a5f4e589803980771c99990`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:03.192036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6aafab43-2da0-4062-a752-011289144da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:03.329012 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 967/1924] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:03.344983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:03.345152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafab43-2da0-4062-a752-011289144da7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:03.346458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6aafab43-2da0-4062-a752-011289144da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:03.347407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:03.429859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103a74-7ca4-4098-8d9d-0e968052dba6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:03.433546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:03.434166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.434453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.434726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.445366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:03.446181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.450078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafab43-2da0-4062-a752-011289144da7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:03.455308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:03.456260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.456759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.457224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] PATH_INFO: `/v3/users/ef29345da6d04a4182987a24d428fa56` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.458713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef29345da6d04a4182987a24d428fa56)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:03.461479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.469096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 958/1925] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:03.512992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:03.517480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:03.522617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a7c2-f136-4a8e-9ef3-20b7b2d1b699 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:03.527969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:03.528698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.529042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.529370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.538478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef29345da6d04a4182987a24d428fa56'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:03.539382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef29345da6d04a4182987a24d428fa56'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:03.550073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef29345da6d04a4182987a24d428fa56'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:03.560542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef29345da6d04a4182987a24d428fa56'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:03.579327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61063c41-8f2d-475e-bdcd-da797eb07f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef29345da6d04a4182987a24d428fa56'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:03.589930 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 968/1926] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:03 2022] DELETE /identity/v3/users/ef29345da6d04a4182987a24d428fa56 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:03.597268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.597676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.598033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.614824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:03.616769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.619795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:03.621260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:03.629525 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 959/1927] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:03.718187 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 969/1928] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:03.727814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:03.730214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:03.789677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:03.808858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f24c-3c69-47f2-9333-54fab21ab275 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:03.912372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:03.912890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:03.913208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:03.913476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:03.925935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:03.927920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:03.943697 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 960/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:04.837405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:04.838925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:04.852057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc950e-995a-4801-b555-80e23d87d063 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:04.857392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:04.858021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:04.858489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:04.858767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] PATH_INFO: `/v3/projects/af831e6b68334c038f8fe58b01022859` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:04.860047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af831e6b68334c038f8fe58b01022859)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:04.862008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:04.926686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af831e6b68334c038f8fe58b01022859', 'request_id': 'req-a2e89743-96ef-4d85-8ada-0ebdb163bb35'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:04.934612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af831e6b68334c038f8fe58b01022859', 'request_id': 'req-a2e89743-96ef-4d85-8ada-0ebdb163bb35'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:04.944386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af831e6b68334c038f8fe58b01022859', 'request_id': 'req-a2e89743-96ef-4d85-8ada-0ebdb163bb35'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:04.959126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] The token cache is being invalidate because project af831e6b68334c038f8fe58b01022859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:04.959410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:04.960138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:04.961760 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 970/1930] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:04 2022] DELETE /identity/v3/projects/af831e6b68334c038f8fe58b01022859 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:04.965917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:04.980811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b739-eb45-4955-afb4-178aa9ba5cf7 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:05.062433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:05.063263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:05.063671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:05.064049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] PATH_INFO: `/v3/users/b61b9b1eb63a4bb7bd7871c7961b3158` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:05.065413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61b9b1eb63a4bb7bd7871c7961b3158)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:05.067723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:05.127343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61b9b1eb63a4bb7bd7871c7961b3158'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:05.144033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61b9b1eb63a4bb7bd7871c7961b3158'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:05.153257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61b9b1eb63a4bb7bd7871c7961b3158'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:05.153989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61b9b1eb63a4bb7bd7871c7961b3158'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:05.154674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-42947b91-e562-4d3d-84d6-27e2278d1f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61b9b1eb63a4bb7bd7871c7961b3158'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:05.179287 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 961/1931] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:04 2022] DELETE /identity/v3/users/b61b9b1eb63a4bb7bd7871c7961b3158 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:05.990565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:05.994729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:06.012895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89743-96ef-4d85-8ada-0ebdb163bb35 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.060162 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:06.098450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.099331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.099607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.099962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] PATH_INFO: `/v3/projects/d889438c4d884b30927f7be055e1ee28` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.101117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d889438c4d884b30927f7be055e1ee28)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.103101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.161925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd889438c4d884b30927f7be055e1ee28', 'request_id': 'req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:06.167409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd889438c4d884b30927f7be055e1ee28', 'request_id': 'req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:06.175883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd889438c4d884b30927f7be055e1ee28', 'request_id': 'req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:06.188901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] The token cache is being invalidate because project d889438c4d884b30927f7be055e1ee28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:06.189287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:06.190035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2fb87d85-08eb-43a1-ac60-d9e7256c1a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:06.191766 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 971/1932] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:05 2022] DELETE /identity/v3/projects/d889438c4d884b30927f7be055e1ee28 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:06.196792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.197331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.197428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.221480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:06.222820 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:06.242302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:06.295567 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 962/1933] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:06.303905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.304296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.304638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.332765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:06.334036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:06.343672 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 972/1934] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:06.348379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.362816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09541aa8-2cbd-4459-a913-48eab5c7d3c8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.368166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.368801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.369077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.369487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.370162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:06.370475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.372210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.385036 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 963/1935] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:06.389737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.400915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e7451-e342-481b-b68a-5384986346d8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.407544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.408646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.409103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.409598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.410946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.414024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.446705 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 973/1936] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:06.451176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.462596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3f10-9de4-474c-9070-f1428c6e768d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.534949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.536133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.536408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.536676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.537309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.539220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.565429 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 964/1937] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:06.566972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.577786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176511-9f5e-4a8d-855a-a95cce60c0de admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.582503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.583147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.583430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.583697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.584497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.586031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.602899 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 974/1938] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:06.603370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.614647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9b22-92f2-4203-bc99-c79bad431bb1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.620068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.620829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.621114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.621383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.622035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.623759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6a030-8ad3-47bb-853a-fbc182139269 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.635967 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 965/1939] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:06.640317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.650910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068b12-04f0-42ad-a4f7-3ed623a0c42f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.655624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.656347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.656620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.656889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] PATH_INFO: `/v3/projects/83d97e516ac3422888013b822f864f71/users/9991c8aaf39d4f8985b6355d32f66e2d/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.674337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d97e516ac3422888013b822f864f71, user_id=9991c8aaf39d4f8985b6355d32f66e2d, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.677222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.692663 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 975/1940] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:06 2022] PUT /identity/v3/projects/83d97e516ac3422888013b822f864f71/users/9991c8aaf39d4f8985b6355d32f66e2d/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:06.704156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.704438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.704707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.732000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] MFA Rules not processed for user `9991c8aaf39d4f8985b6355d32f66e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:06.733314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:06.807349 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 966/1941] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:06.811654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.877453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b69c5f-d732-4447-aed5-776633eb31bb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.883290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:06.884009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:06.884385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:06.884613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:06.885305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:06.887560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:06.892697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:06.924426 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 976/1942] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:06.926107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:06.938673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad609d3-2d6d-4e7e-8799-68475096adc5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:06.950764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:07.001515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.002133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.002411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.002673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.003362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.005342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.030787 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 967/1943] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:06 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:07.032116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.044547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85343b-d47e-47f0-939b-3b25d053119f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.050589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.051608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.051883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.052319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.053031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.054891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.063806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.065907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.068438 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 977/1944] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:07.072633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.078814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd99cf-866c-46ca-b316-972e6d8b5fb9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.083464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb700-7d83-4984-a776-49fec48d5c1a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.083754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.084705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.085231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.085722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] PATH_INFO: `/v3/users/ea360cd3ce3b482c945766269ab4a315` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.087008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea360cd3ce3b482c945766269ab4a315)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.088760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.089150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.089422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.089694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.089962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] PATH_INFO: `/v3/projects/248d8b5f0db742878c546b0e559e8e3c/users/22826ab4c594417b8d35a89c753a1ba4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.110726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248d8b5f0db742878c546b0e559e8e3c, user_id=22826ab4c594417b8d35a89c753a1ba4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.113739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.132511 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 978/1945] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:07 2022] PUT /identity/v3/projects/248d8b5f0db742878c546b0e559e8e3c/users/22826ab4c594417b8d35a89c753a1ba4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:07.137210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.152057 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea360cd3ce3b482c945766269ab4a315'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:07.174983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea360cd3ce3b482c945766269ab4a315'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:07.187541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea360cd3ce3b482c945766269ab4a315'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:07.188365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea360cd3ce3b482c945766269ab4a315'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:07.189089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5ef6943c-d095-454a-8720-c7d8cd8eb671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea360cd3ce3b482c945766269ab4a315'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:07.222749 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 968/1946] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:07 2022] DELETE /identity/v3/users/ea360cd3ce3b482c945766269ab4a315 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:07.226812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.227105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54109-f639-4cd7-8e67-733b1800b519 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.227214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.227535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.252625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:07.256029 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.302590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.303306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.303571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.304048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.304527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.306268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.317646 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 979/1947] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:07.318670 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 969/1948] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:07.322529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.324201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.328374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.329702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.336467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672d40a-170b-4059-a28c-5e4fca4b86a9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.341085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.341743 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.342018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.342289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] PATH_INFO: `/v3/projects/248d8b5f0db742878c546b0e559e8e3c/users/22826ab4c594417b8d35a89c753a1ba4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.344223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=248d8b5f0db742878c546b0e559e8e3c, user_id=22826ab4c594417b8d35a89c753a1ba4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.346887 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cb9b1-520c-4d35-9478-1197e7d474ec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.352139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:07.358267 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 980/1949] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:07 2022] PUT /identity/v3/projects/248d8b5f0db742878c546b0e559e8e3c/users/22826ab4c594417b8d35a89c753a1ba4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:07.369310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.369594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.369861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.400276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062d60-f053-4a47-97fd-a4ac5bafea42 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.401054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] MFA Rules not processed for user `22826ab4c594417b8d35a89c753a1ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:07.402492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.432728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:07.451897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.452558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.452894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.453180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.475705 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 981/1950] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:07.487907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.489733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.517739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.519236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.530769 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 970/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:07.558849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47242d-ca20-4644-9770-339cd37906a3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.562543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.563186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.563510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.563812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.573472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.574943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.585040 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 982/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:07.684193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.694866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43253889-26dd-4065-9ea4-5600f12d4a44 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.699188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.699984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.700312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.700760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.702636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.773195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.774649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:07.788064 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 971/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:07.918481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:07.919928 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:07.945727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af59f-a0e8-4680-8f24-e8d3af982cba service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:07.951434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:07.952540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:07.952984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:07.953264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] PATH_INFO: `/v3/projects/2abdc9abd2da4b5d857a5fa1211264da` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:07.954776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abdc9abd2da4b5d857a5fa1211264da)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:07.958398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:08.019941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abdc9abd2da4b5d857a5fa1211264da', 'request_id': 'req-d3a16067-8197-427f-b886-2e83167e8c57'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.026194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abdc9abd2da4b5d857a5fa1211264da', 'request_id': 'req-d3a16067-8197-427f-b886-2e83167e8c57'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.033905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abdc9abd2da4b5d857a5fa1211264da', 'request_id': 'req-d3a16067-8197-427f-b886-2e83167e8c57'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.045654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] The token cache is being invalidate because project 2abdc9abd2da4b5d857a5fa1211264da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:08.045870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.046480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.048015 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 983/1954] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:07 2022] DELETE /identity/v3/projects/2abdc9abd2da4b5d857a5fa1211264da => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:08.052235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:08.062718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379939a3-52be-4cbc-88b9-32696c7e57b1 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:08.082864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:08.129382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:08.130139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:08.130490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:08.130829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] PATH_INFO: `/v3/users/146e6606ccd2423786873eac44444a95` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:08.132215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146e6606ccd2423786873eac44444a95)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:08.134254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:08.188652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146e6606ccd2423786873eac44444a95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.201111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146e6606ccd2423786873eac44444a95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.209502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146e6606ccd2423786873eac44444a95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.210089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146e6606ccd2423786873eac44444a95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.210688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146e6606ccd2423786873eac44444a95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.223013 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 972/1955] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:08 2022] DELETE /identity/v3/users/146e6606ccd2423786873eac44444a95 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:08.674219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:08.675905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:08.699622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16067-8197-427f-b886-2e83167e8c57 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:08.750667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:08.762657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:08.763322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:08.763944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:08.764433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] PATH_INFO: `/v3/projects/f0f5df3e46e5481e99a5e7f45270ddd4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:08.766128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f5df3e46e5481e99a5e7f45270ddd4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:08.768166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:08.819780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f5df3e46e5481e99a5e7f45270ddd4', 'request_id': 'req-7e004f1e-4019-4fb4-800f-1048939be5a6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.825758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f5df3e46e5481e99a5e7f45270ddd4', 'request_id': 'req-7e004f1e-4019-4fb4-800f-1048939be5a6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.835093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f5df3e46e5481e99a5e7f45270ddd4', 'request_id': 'req-7e004f1e-4019-4fb4-800f-1048939be5a6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.846573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] The token cache is being invalidate because project f0f5df3e46e5481e99a5e7f45270ddd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:08.847071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.847854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:08.849448 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 984/1956] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:08 2022] DELETE /identity/v3/projects/f0f5df3e46e5481e99a5e7f45270ddd4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:08.853715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:08.855387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:08.869004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e43f2-9a70-4a8e-858d-cfd2bcb44f62 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:08.926546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:08.927339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:08.927682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:08.928050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] PATH_INFO: `/v3/users/f126dc1e5a5f4e589803980771c99990` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:08.929192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f126dc1e5a5f4e589803980771c99990)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:08.931308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:09.012183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:09.012863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f126dc1e5a5f4e589803980771c99990'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.035574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f126dc1e5a5f4e589803980771c99990'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.052418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f126dc1e5a5f4e589803980771c99990'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.053140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f126dc1e5a5f4e589803980771c99990'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.053782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7601f816-2381-4b16-99e9-65f38b012089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f126dc1e5a5f4e589803980771c99990'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.074573 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 973/1957] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:08 2022] DELETE /identity/v3/users/f126dc1e5a5f4e589803980771c99990 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:09.476422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:09.479186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:09.533726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e004f1e-4019-4fb4-800f-1048939be5a6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:09.696058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:09.696058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.696058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.696058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] PATH_INFO: `/v3/projects/875e360390904ad7a6e9f250dece9369` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.696958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875e360390904ad7a6e9f250dece9369)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:09.700055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:09.763959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875e360390904ad7a6e9f250dece9369', 'request_id': 'req-3837f351-813b-45bc-9eba-e6800f010f45'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.777787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875e360390904ad7a6e9f250dece9369', 'request_id': 'req-3837f351-813b-45bc-9eba-e6800f010f45'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.790221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875e360390904ad7a6e9f250dece9369', 'request_id': 'req-3837f351-813b-45bc-9eba-e6800f010f45'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.809194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] The token cache is being invalidate because project 875e360390904ad7a6e9f250dece9369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:09.809489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.810166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3837f351-813b-45bc-9eba-e6800f010f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:09.816238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 985/1958] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:09 2022] DELETE /identity/v3/projects/875e360390904ad7a6e9f250dece9369 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:09.818255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.818738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.818844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.840440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:09.841622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:09.898041 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 974/1959] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:09.906356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.906633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.906900 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.927359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:09.928663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:09.937674 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 986/1960] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:09.942224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:09.953003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b0beb-fda0-4ea1-95b2-34ccfd707433 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:09.958718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:09.959326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.959593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.959911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.960574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:09.960909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:09.962587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:09.974268 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 975/1961] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:09.979030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:09.984807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:09.989012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a19d2b-629a-4ef1-a84f-6470498f763b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:09.995246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:09.996323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:09.996443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:09.996720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:09.997733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:09.999571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.029993 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 987/1962] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:09 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:10.034583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.045002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f829f-dd08-41ee-b9d7-1d1760c5ed06 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.105474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.106107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.106379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.106633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.107287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.109229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.136284 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 976/1963] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:10 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:10.140571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.151171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd935-4046-4dec-b269-607db8e7f659 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.155536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.156137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.156557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.156830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.157534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.159124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.171208 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 988/1964] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:10.175550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.186908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e5f8d-55a1-4488-8140-0a0713541bda admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.192624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.193258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.193543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.193946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.194610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.196256 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df700e9-322e-4603-9fac-0121876dc47b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.209118 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 977/1965] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:10.214064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.225090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c9c2-bf4e-4c47-9026-155e57ff990b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.231498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.232353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.232754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.232885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] PATH_INFO: `/v3/projects/97cd62b7296f409d9db725f9303bcbe6/users/17b50aedda254ee88cf6521f1d9dac21/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.249455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cd62b7296f409d9db725f9303bcbe6, user_id=17b50aedda254ee88cf6521f1d9dac21, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.252730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.266699 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 989/1966] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:10 2022] PUT /identity/v3/projects/97cd62b7296f409d9db725f9303bcbe6/users/17b50aedda254ee88cf6521f1d9dac21/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:10.280054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.280337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.280605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.310035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] MFA Rules not processed for user `17b50aedda254ee88cf6521f1d9dac21`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:10.311225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:10.327474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:10.377807 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 978/1967] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:10.411027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.412846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:10.472803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4720131-b307-4ec3-bfa6-ff7b8e1cfc9a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.476880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.477516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.477763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.478034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.488304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.490419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55228cf7-225c-4dcf-97c9-84bf0ee52c66 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.500599 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 990/1968] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:10.516625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.591317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d6dad-962d-441d-aa8f-b61f0dee70b5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.597759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.598407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.598682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.598952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] PATH_INFO: `/v3/users/17b50aedda254ee88cf6521f1d9dac21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.600317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b50aedda254ee88cf6521f1d9dac21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.602251 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.653482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b50aedda254ee88cf6521f1d9dac21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:10.666410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b50aedda254ee88cf6521f1d9dac21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:10.675512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b50aedda254ee88cf6521f1d9dac21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:10.676231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b50aedda254ee88cf6521f1d9dac21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:10.676906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b50aedda254ee88cf6521f1d9dac21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:10.693398 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 979/1969] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:10 2022] DELETE /identity/v3/users/17b50aedda254ee88cf6521f1d9dac21 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:10.697951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.698486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.699034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.719483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:10.720751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:10.784768 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 991/1970] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:10.798438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:10.799998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:10.885152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:10.910925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95849770-981e-4a76-9dac-2e86be185285 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:10.915993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:10.916824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:10.917294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:10.917745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:10.938876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:10.940798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bdf04-dd4a-43a4-be76-c5d6a48eee25 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:10.952410 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 980/1971] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:11.002529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.004260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.018259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6e8d-c8c4-494a-b8f7-ad8e9ff7cf1c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.023818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.024473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.024753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.025105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] PATH_INFO: `/v3/users/9991c8aaf39d4f8985b6355d32f66e2d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.026400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9991c8aaf39d4f8985b6355d32f66e2d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.028537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.109569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:11.111422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9991c8aaf39d4f8985b6355d32f66e2d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.112199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9991c8aaf39d4f8985b6355d32f66e2d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.124836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9991c8aaf39d4f8985b6355d32f66e2d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.136458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9991c8aaf39d4f8985b6355d32f66e2d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.162054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9991c8aaf39d4f8985b6355d32f66e2d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.167646 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 992/1972] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:11 2022] DELETE /identity/v3/users/9991c8aaf39d4f8985b6355d32f66e2d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:11.171855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.172360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.172730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.200713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:11.202158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.272067 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 981/1973] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:11.486713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.488641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.517198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.518817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.537242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3a661-ad29-475f-98dd-9fdb34c5c596 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.541642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.542377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.542714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.543085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] PATH_INFO: `/v3/projects/97cd62b7296f409d9db725f9303bcbe6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.545045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cd62b7296f409d9db725f9303bcbe6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.547557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.551683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae39ff-c47e-4798-91ee-3786535b06b2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.556005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.556809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.557084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.557346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.566622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.568119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924f34b-f33a-4ca7-9ba4-4ce3f56ce3be service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.578192 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 993/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:11.602118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cd62b7296f409d9db725f9303bcbe6', 'request_id': 'req-60b902a5-9ada-4832-93e5-75c899fba5a7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.608698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cd62b7296f409d9db725f9303bcbe6', 'request_id': 'req-60b902a5-9ada-4832-93e5-75c899fba5a7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.620868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cd62b7296f409d9db725f9303bcbe6', 'request_id': 'req-60b902a5-9ada-4832-93e5-75c899fba5a7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.635408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] The token cache is being invalidate because project 97cd62b7296f409d9db725f9303bcbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:11.635889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.636633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60b902a5-9ada-4832-93e5-75c899fba5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:11.638472 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 982/1975] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:11 2022] DELETE /identity/v3/projects/97cd62b7296f409d9db725f9303bcbe6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:11.643729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.644865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.645144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.666683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:11.667931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.736001 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 994/1976] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:11.744471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.744802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.745077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.771837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:11.773086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.781008 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 983/1977] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:11.786411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.796285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f4a7d-d644-405d-b32a-5a089dcbdb79 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.802322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.802943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.803218 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.803484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.804179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:11.804480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.806098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.818877 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 995/1978] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:11.823415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.833774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5c80-4cf9-4144-8f12-3cf8e2578307 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.838607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.839223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.839497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.839765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.840426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.842327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.868853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.870671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:11.874084 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 984/1979] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:11.878060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:11.888869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb74e-e7fb-4913-be4d-a8d4bdc1bf45 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.921826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:11.953736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e4bb-a442-4e8a-9f24-296f6f745285 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:11.958821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.959439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.959712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.960010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.960637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.960766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:11.963027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.971282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:11.973003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:11.973305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:11.973763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] PATH_INFO: `/v3/projects/83d97e516ac3422888013b822f864f71` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:11.975227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d97e516ac3422888013b822f864f71)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:11.977497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:11.992655 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 985/1980] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:11 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:11.998041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.011832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e75aa-ae66-4883-8c23-6b5adc001e7c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.018192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.019808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.020348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.020500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.021084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.022826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:12.037203 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 986/1981] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:12.038662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.048982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d97e516ac3422888013b822f864f71', 'request_id': 'req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.060597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d97e516ac3422888013b822f864f71', 'request_id': 'req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.073684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d13460-03e6-4177-aa3f-dd882a282359 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.077662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d97e516ac3422888013b822f864f71', 'request_id': 'req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.097249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] The token cache is being invalidate because project 83d97e516ac3422888013b822f864f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:12.097894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.098973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.101125 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 996/1982] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:11 2022] DELETE /identity/v3/projects/83d97e516ac3422888013b822f864f71 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:12.107415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.110407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:12.175849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.176849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.177625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.178059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.179116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.182061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:12.206799 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 987/1983] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:12.208548 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.213238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:12.244584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a20659-ba50-4e1f-8061-03a46b2438b3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.250089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.250324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2024c41-224a-4a45-8bc6-00ff3f1ed8d1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.250879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.251315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.251691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] PATH_INFO: `/v3/projects/50a921de7b2b4dd9ae0c70e414920c1f/users/728c234a3b9b4e9a9235b609fbf0ee13/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.258428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.259160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.259430 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.259704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] PATH_INFO: `/v3/users/22826ab4c594417b8d35a89c753a1ba4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.261361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22826ab4c594417b8d35a89c753a1ba4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.263421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:12.270662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a921de7b2b4dd9ae0c70e414920c1f, user_id=728c234a3b9b4e9a9235b609fbf0ee13, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.273474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbab86-348c-4c81-8514-ddfcd53906c1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:12.308325 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 988/1984] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:12 2022] PUT /identity/v3/projects/50a921de7b2b4dd9ae0c70e414920c1f/users/728c234a3b9b4e9a9235b609fbf0ee13/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:12.320217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.320537 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.320850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.357549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] MFA Rules not processed for user `728c234a3b9b4e9a9235b609fbf0ee13`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:12.358808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:12.373211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22826ab4c594417b8d35a89c753a1ba4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.378824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22826ab4c594417b8d35a89c753a1ba4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.415296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22826ab4c594417b8d35a89c753a1ba4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.431919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22826ab4c594417b8d35a89c753a1ba4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.454825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22826ab4c594417b8d35a89c753a1ba4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:12.484287 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 997/1985] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:12 2022] DELETE /identity/v3/users/22826ab4c594417b8d35a89c753a1ba4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:12.510646 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 989/1986] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:12.525301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.528777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:12.537524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:12.617470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac114f-5853-41e1-b1b4-5d7c895258a2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.621719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.622275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.622548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.622807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.692091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.693741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ec743-c3c7-425b-b06d-64156762a46a service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:12.705222 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 998/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:12.808540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:12.810602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:12.856049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:12.915761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a060e7-a5ee-4ff7-a64f-7ae0c4c19422 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:12.987406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:12.988165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:12.988621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:12.988735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] PATH_INFO: `/v3/projects/248d8b5f0db742878c546b0e559e8e3c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:12.989928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248d8b5f0db742878c546b0e559e8e3c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:12.992134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.057331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248d8b5f0db742878c546b0e559e8e3c', 'request_id': 'req-bef14785-bacf-44f9-9f3a-a09b85f0a338'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:13.065331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248d8b5f0db742878c546b0e559e8e3c', 'request_id': 'req-bef14785-bacf-44f9-9f3a-a09b85f0a338'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:13.088844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248d8b5f0db742878c546b0e559e8e3c', 'request_id': 'req-bef14785-bacf-44f9-9f3a-a09b85f0a338'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:13.105223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] The token cache is being invalidate because project 248d8b5f0db742878c546b0e559e8e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:13.105525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:13.106185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bef14785-bacf-44f9-9f3a-a09b85f0a338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:13.108425 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 990/1988] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:12 2022] DELETE /identity/v3/projects/248d8b5f0db742878c546b0e559e8e3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:13.114683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.115148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.115588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.142297 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:13.143767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:13.209752 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 999/1989] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:13.218320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.218718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.219109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.239703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:13.240923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:13.248780 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 991/1990] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:13.253909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.263802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38326d2-9eb8-4ef3-b83d-91bcec66271c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.268283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.268986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.269530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.269530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.270752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:13.271055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.272724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.293689 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1000/1991] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:13.299194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.308640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4df3-7698-4799-a497-b4261985a83f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.313446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.314149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.314427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.314742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.315412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.317432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.354489 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 992/1992] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:13.358764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.371090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74021f74-d4bf-487e-974a-be1c6b402de0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.416458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:13.432308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.432927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.433202 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.433538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.434170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.436172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.460195 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1001/1993] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:13.464468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.477477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2776a-c401-40bc-8c9d-f1749ad3185b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.482859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.483443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.483767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.484099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.484783 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.486380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.516424 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 993/1994] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:13.517750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.529624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea263e-098d-486f-9aaa-4e13e370e359 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.535463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.536229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.536560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.536892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.537624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.539379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780385f1-b3cd-4602-ab97-8c04cce155ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.553839 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1002/1995] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:13.554947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.566596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f6d6-6622-4e67-9235-90c70362c9ee admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.571756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.572433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.572716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.572986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] PATH_INFO: `/v3/projects/96c83f6ffbae494d837dd8ecf246f8d8/users/1db30ccdf3a44691b6d00735f47b5645/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.588288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:13.592554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c83f6ffbae494d837dd8ecf246f8d8, user_id=1db30ccdf3a44691b6d00735f47b5645, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.595894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.615806 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 994/1996] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:13 2022] PUT /identity/v3/projects/96c83f6ffbae494d837dd8ecf246f8d8/users/1db30ccdf3a44691b6d00735f47b5645/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:13.626345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.626658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.626915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.659529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] MFA Rules not processed for user `1db30ccdf3a44691b6d00735f47b5645`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:13.661726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:13.742236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1003/1997] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:13.747086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.822144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81980fb9-9a78-4f9e-8be7-92b7e803e9e9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.828943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.829577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.829874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.830187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.830859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.833077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.864954 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 995/1998] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:13.866273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:13.877207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e5e4-41c7-479b-8fb5-0276bb518685 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:13.953609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:13.954272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:13.954548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:13.954818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:13.955455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:13.957508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:13.987224 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1004/1999] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:13 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:13.992033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:14.020898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6c7b-16a7-4e08-ac7e-039450510972 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:14.028347 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:14.029318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.029592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.029863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.030524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:14.032213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:14.048723 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 996/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:14.050191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:14.069459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3144-e3a9-4d2b-b191-dff95071d106 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:14.074410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:14.075094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.075367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.075634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] PATH_INFO: `/v3/projects/d53137d08c174935b680f6818b75fcd6/users/fd04457b01b54da3a4d99634ace9b0b3/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.091666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53137d08c174935b680f6818b75fcd6, user_id=fd04457b01b54da3a4d99634ace9b0b3, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:14.094735 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d875-ba81-4c9e-bd6a-493ffaf86cdf admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:14.109918 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1005/2001] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:14 2022] PUT /identity/v3/projects/d53137d08c174935b680f6818b75fcd6/users/fd04457b01b54da3a4d99634ace9b0b3/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:14.114025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:14.124321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeee-d4ab-4f1d-b7de-5d297b651936 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:14.161602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.161826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.162038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.183824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] MFA Rules not processed for user `728c234a3b9b4e9a9235b609fbf0ee13`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:14.185052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:14.189366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:14.190107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.190380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.190781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.191642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:14.193766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:14.201370 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:14.209426 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 997/2002] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:14.213879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:14.225633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e8e2-2f3d-4bc2-852c-c73dce148670 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:14.231291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:14.231884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.232242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.232560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] PATH_INFO: `/v3/projects/d53137d08c174935b680f6818b75fcd6/users/fd04457b01b54da3a4d99634ace9b0b3/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.234673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53137d08c174935b680f6818b75fcd6, user_id=fd04457b01b54da3a4d99634ace9b0b3, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:14.237712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75960f7-a6e5-4833-9409-45f3c1b6eca6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:14.250309 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 998/2003] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:14 2022] PUT /identity/v3/projects/d53137d08c174935b680f6818b75fcd6/users/fd04457b01b54da3a4d99634ace9b0b3/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:14.259459 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1006/2004] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:14.261184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.261468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.261719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.294209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] MFA Rules not processed for user `fd04457b01b54da3a4d99634ace9b0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:14.295456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:14.334758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:14.391698 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 999/2005] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:14.401011 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:14.402726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:14.480471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b79e-ab84-4569-b267-94d16e4ea86f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:14.571770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:14.573657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:14.574085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:14.574838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:14.694644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:14.696391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390f70f-eda7-429c-be77-fccb1097f07c service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:14.711330 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1007/2006] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:16.459466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:16.462214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:16.652794 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e421d6-47ea-4d0c-8917-d7b4c2c1ef0d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:16.664367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:16.665201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:16.665827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:16.673839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] PATH_INFO: `/v3/users/1a36fbae16574438831f53355ba99190` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:16.676422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a36fbae16574438831f53355ba99190)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:16.683385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:16.794230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a36fbae16574438831f53355ba99190'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:16.822405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a36fbae16574438831f53355ba99190'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:16.836705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a36fbae16574438831f53355ba99190'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:16.837881 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a36fbae16574438831f53355ba99190'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:16.839309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a36fbae16574438831f53355ba99190'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:16.873394 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1000/2007] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:16 2022] DELETE /identity/v3/users/1a36fbae16574438831f53355ba99190 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:16.878221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:16.878744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:16.878880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:16.914905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:16.916410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:16.957257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.010869 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1008/2008] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:17.022948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.024655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.090122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.091788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.101321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20982-1444-43b0-a1e2-84f94c7114bc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:17.105637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:17.106525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.106911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.107333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.108334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859b695-f9a3-40ec-a597-a079d75d131f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:17.114391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.114765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:17.115425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.115698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.116081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] PATH_INFO: `/v3/users/73d980bfe05f4ca581a94ef8e6615274` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.117942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d980bfe05f4ca581a94ef8e6615274)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:17.118764 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:17.119926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:17.120909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:17.133959 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1001/2009] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:17.186487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d980bfe05f4ca581a94ef8e6615274'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.187851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d980bfe05f4ca581a94ef8e6615274'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.197997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d980bfe05f4ca581a94ef8e6615274'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.208506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d980bfe05f4ca581a94ef8e6615274'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.229057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d980bfe05f4ca581a94ef8e6615274'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.237102 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1009/2010] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:17 2022] DELETE /identity/v3/users/73d980bfe05f4ca581a94ef8e6615274 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:17.508655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.511260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.525602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f735e-7b78-4b15-a884-d5019636959f service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:17.580333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.583623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.647122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:17.648228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.648505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.648885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] PATH_INFO: `/v3/projects/4489da72cb074a49987c31e9ee8aa5c2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.650193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4489da72cb074a49987c31e9ee8aa5c2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:17.652263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:17.676219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49052010-9fde-431c-b1b9-773803d59d49 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:17.681320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:17.682136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.682536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.682885 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] PATH_INFO: `/v3/projects/2814f05d22444ffcbef4ca182b205f72` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.686842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2814f05d22444ffcbef4ca182b205f72)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:17.688947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:17.707814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4489da72cb074a49987c31e9ee8aa5c2', 'request_id': 'req-d2431523-72f0-4648-9315-e3c226d86756'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.714456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4489da72cb074a49987c31e9ee8aa5c2', 'request_id': 'req-d2431523-72f0-4648-9315-e3c226d86756'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.725243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4489da72cb074a49987c31e9ee8aa5c2', 'request_id': 'req-d2431523-72f0-4648-9315-e3c226d86756'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.739219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] The token cache is being invalidate because project 4489da72cb074a49987c31e9ee8aa5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:17.739594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.741033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d2431523-72f0-4648-9315-e3c226d86756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.742686 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1002/2011] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:17 2022] DELETE /identity/v3/projects/4489da72cb074a49987c31e9ee8aa5c2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:17.748012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333297-411f-482a-873b-a9a44906b597 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.748447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333297-411f-482a-873b-a9a44906b597 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.748745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333297-411f-482a-873b-a9a44906b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.769775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.771592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2814f05d22444ffcbef4ca182b205f72', 'request_id': 'req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.779993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-83333297-411f-482a-873b-a9a44906b597 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:17.781394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2814f05d22444ffcbef4ca182b205f72', 'request_id': 'req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.781730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83333297-411f-482a-873b-a9a44906b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.795666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2814f05d22444ffcbef4ca182b205f72', 'request_id': 'req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.816518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] The token cache is being invalidate because project 2814f05d22444ffcbef4ca182b205f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:17.816915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.817711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eec5aa9-de36-4de1-bcdf-8a985cbe3ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:17.824118 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1010/2012] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:17 2022] DELETE /identity/v3/projects/2814f05d22444ffcbef4ca182b205f72 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:17.825622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.825981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.833736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.858277 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1003/2013] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:17.866874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.867157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.867478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.885705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:17.887040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.895773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:17.897025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.911082 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1004/2014] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:17.911082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.919973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.920283 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1011/2015] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:17.920283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.928614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e3565-634b-463e-a71a-7372e2a650fd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:17.934294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:17.934997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.935450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.935763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.936822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:17.937176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:17.939046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2c27a-3df4-4592-b432-e98fba4876ea admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:17.945510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.954089 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1012/2016] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:17.956872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:17.957420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:17.961233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:17.982371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:17.983879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:17.996781 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1013/2017] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:17.996781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:17.999015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aad1b-a704-4119-b7e6-d7b3a77a653b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.003725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.004547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.004933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.005286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.007252 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293f538-4c93-4e63-bb1b-9d5df3ee25b1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.007377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:18.012774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.014006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.014399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.014806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.015544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.018246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.071804 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1014/2018] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:17 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:18.073158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.099696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.101356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.133158 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1005/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:18.137477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.148104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f209-eabd-4386-903b-3c129b462ab9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.150068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149df-7e00-4f7c-bcbb-8ed8ae8f7afe service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.154157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.154893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.155080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.155292 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.155628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.155755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.155986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.156253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.156554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:18.156877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.156984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.158782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.158907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.173339 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1015/2020] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:18.178423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.186987 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1006/2021] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:18.190317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf220cf3-7328-41cd-bcf8-116b2d34d6b5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.191728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.195772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.196585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.197030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.197309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.198408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.200876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.206400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c675d9-6741-42c2-b6cd-26a42bfbfe6e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.236966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.236966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.236966 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.237328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.237944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.239576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.245833 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1016/2022] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:18.246756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.267825 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1007/2023] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:18.269363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.287293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2856e2-3636-4ff4-a014-aaae6afa71c6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.357844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550508f6-3c00-43c1-96ca-b337a5a541b1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.366867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.367508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.367846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.368119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.368763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.370715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.386963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:18.409795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.411355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.411642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.412060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.412726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.418929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.420365 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1017/2024] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:18.422592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.439210 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1008/2025] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:18.446176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d031e-320e-4abc-ae02-eeb4bdddaac5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.447033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.457754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.458461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.458806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.458958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bc34-5acc-42f9-aa11-8732d856f2b6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.459192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.459955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.475036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.477493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.477634 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1018/2026] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:18.481058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.481058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.481058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] PATH_INFO: `/v3/projects/96146e4bde3246e3a7d9c2de2681061a/users/cad4d1c54b64427cab8c21470a333541/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.482643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.494908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9fb-8941-4f2f-b4e1-b16915a80847 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.499635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.500273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.500553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.500818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.501473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.503158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.505006 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96146e4bde3246e3a7d9c2de2681061a, user_id=cad4d1c54b64427cab8c21470a333541, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.508145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3414409-ad2b-4afe-89fe-96020eaf2700 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.523399 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1019/2027] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:18.524703 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1009/2028] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:18 2022] PUT /identity/v3/projects/96146e4bde3246e3a7d9c2de2681061a/users/cad4d1c54b64427cab8c21470a333541/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:18.534910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.536676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.536959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.537230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.542451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa4db-de94-49f8-9dd1-d933c9f759d5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.559387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:18.571546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] MFA Rules not processed for user `cad4d1c54b64427cab8c21470a333541`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:18.572982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:18.635086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.636509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.637027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.637477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] PATH_INFO: `/v3/projects/a37e1d173617471aa7e4b7bea7951312/users/567651a294ab43adbc34aa46f692a4f0/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.656080 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1010/2029] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:18.656411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37e1d173617471aa7e4b7bea7951312, user_id=567651a294ab43adbc34aa46f692a4f0, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.659799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abff4-a3e6-410d-b843-2824f45b593b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.661180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.674472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c545-6bbf-463a-bda5-0e1752e8d286 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.675592 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1020/2030] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:18 2022] PUT /identity/v3/projects/a37e1d173617471aa7e4b7bea7951312/users/567651a294ab43adbc34aa46f692a4f0/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:18.687497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.687809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.688253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.722967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] MFA Rules not processed for user `567651a294ab43adbc34aa46f692a4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:18.723666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:18.746093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.746723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.747049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.747350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.748104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.750058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.780546 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1011/2031] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:18.784418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.799226 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1021/2032] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:18.811113 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.812625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:18.862043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:18.862923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779209f2-8598-4445-97ca-4c67e8a2c182 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.868304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.868965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.869247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.869520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.870179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.872150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.898230 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1012/2033] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:18 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:18.899103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d38b3-440c-41c2-b664-0667c4b4424b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.899564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.910702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d30997-4d21-4565-9fac-ade47416510a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.915555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.916351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.916598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.916866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.917549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.919159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.932834 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1013/2034] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:18.936924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.944336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:18.948741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb12-d52b-426e-b817-f07c826d371e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.954800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.955423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.955960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.956237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.957106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:18.958867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:18.969304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.970302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.970585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.970778 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1014/2035] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:18.971132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:18.975666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:18.987856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3463-0940-437d-be22-1ff17f2085a8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:18.994810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:18.995491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:18.995802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:18.996079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] PATH_INFO: `/v3/projects/22c174a6be404de79bbda7be694f4864/users/2d3480d3adf447cbab225a7c886d4497/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.014938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c174a6be404de79bbda7be694f4864, user_id=2d3480d3adf447cbab225a7c886d4497, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.017800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee510ba-db3f-4c46-af5c-dd0ab6faec98 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.032915 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1015/2036] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:18 2022] PUT /identity/v3/projects/22c174a6be404de79bbda7be694f4864/users/2d3480d3adf447cbab225a7c886d4497/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:19.040073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.041944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.044424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.044710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.044982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.052538 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1022/2037] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:19.080803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] MFA Rules not processed for user `2d3480d3adf447cbab225a7c886d4497`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:19.082698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.171776 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1016/2038] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:19.176553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.190613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc8ac-89ce-4ec3-9fba-76a6cf9cc980 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.257590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.258244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.258463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.258837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.259341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.261275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.290950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.293777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:19.303791 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1023/2039] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:19 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:19.303956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822d470-be57-441a-812e-4cfcb9d1f167 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.306517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.371656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.372410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.372750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.373087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] PATH_INFO: `/v3/users/567651a294ab43adbc34aa46f692a4f0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.374266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=567651a294ab43adbc34aa46f692a4f0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.376219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.388854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fadc5-0d65-4d16-adc5-eb9054ac8c22 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.393521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.394167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.394434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.394701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.395366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.397357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.423107 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1024/2040] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:19 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:19.424206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.426257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567651a294ab43adbc34aa46f692a4f0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:19.434119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee9e13-e181-49b5-99b7-a119b56fd976 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.436485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:19.438753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567651a294ab43adbc34aa46f692a4f0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:19.439527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.440156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.440591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.441469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.442143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.443784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.447777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567651a294ab43adbc34aa46f692a4f0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:19.448693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567651a294ab43adbc34aa46f692a4f0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:19.449520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc520624-f775-46a7-81ce-4d278c6eccdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567651a294ab43adbc34aa46f692a4f0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:19.455663 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1025/2041] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:19.460118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.461966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.463715 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1017/2042] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:19 2022] DELETE /identity/v3/users/567651a294ab43adbc34aa46f692a4f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:19.467858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861afc-c521-433d-9758-a54524621402 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.468141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861afc-c521-433d-9758-a54524621402 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.468414 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861afc-c521-433d-9758-a54524621402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.475250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd687ab-31df-448b-a92a-3283a6ea2c86 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.488509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ec861afc-c521-433d-9758-a54524621402 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:19.489743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ec861afc-c521-433d-9758-a54524621402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.536485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.537158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.537615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.537894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] PATH_INFO: `/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f/users/1d65181a12294a619ee0a9985c75b267/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.552442 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1018/2043] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:19.559496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf35bf5c206c4bc2a117bedbd85de67f, user_id=1d65181a12294a619ee0a9985c75b267, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.561834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.562154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861afc-c521-433d-9758-a54524621402 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.563539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ec861afc-c521-433d-9758-a54524621402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.586765 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1026/2044] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:19 2022] PUT /identity/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f/users/1d65181a12294a619ee0a9985c75b267/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:19.590685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.649037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861afc-c521-433d-9758-a54524621402 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.668862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29315b-533e-4478-9504-61cde446be09 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.673884 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.674454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.674753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.675072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.675889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.677555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.679868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:19.693749 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1027/2045] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:19.694723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.710156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8101-496e-4de1-87a9-ab46855f31ee admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.710292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.710710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.710991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.711258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.712856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.713618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.713987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.714325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] PATH_INFO: `/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f/users/1d65181a12294a619ee0a9985c75b267/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.716526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf35bf5c206c4bc2a117bedbd85de67f, user_id=1d65181a12294a619ee0a9985c75b267, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.719973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2745e-56e8-4895-84a5-90ffdf99d969 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.721392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.722863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.732661 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1028/2046] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:19 2022] PUT /identity/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f/users/1d65181a12294a619ee0a9985c75b267/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:19.733609 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1019/2047] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:19.744723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.745006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.745278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.777029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] MFA Rules not processed for user `1d65181a12294a619ee0a9985c75b267`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:19.778529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.864111 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1029/2048] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:19.876403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.878102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:19.923763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:19.944924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded810e7-c400-42ce-b944-5fb537e1efcf service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.008597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.009701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.010487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.010967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.013707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.014188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:20.016650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:20.097015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.099162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef937-4fb7-4626-b2b9-eaaaf0a88064 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.110583 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1020/2049] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:20.116377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134295c-a78f-4eec-9571-c0f9da14a327 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.124451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.125154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.125724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.125724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] PATH_INFO: `/v3/projects/a37e1d173617471aa7e4b7bea7951312` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.127486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37e1d173617471aa7e4b7bea7951312)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.130843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.192932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37e1d173617471aa7e4b7bea7951312', 'request_id': 'req-2de682de-43f4-48ad-a3a2-b7d89662be9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:20.201544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37e1d173617471aa7e4b7bea7951312', 'request_id': 'req-2de682de-43f4-48ad-a3a2-b7d89662be9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:20.217196 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37e1d173617471aa7e4b7bea7951312', 'request_id': 'req-2de682de-43f4-48ad-a3a2-b7d89662be9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:20.227857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:20.233320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] The token cache is being invalidate because project a37e1d173617471aa7e4b7bea7951312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:20.233814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:20.234720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2de682de-43f4-48ad-a3a2-b7d89662be9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:20.237539 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1030/2050] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:20 2022] DELETE /identity/v3/projects/a37e1d173617471aa7e4b7bea7951312 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:20.242864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.243396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.243804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.269019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:20.270853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:20.377556 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1021/2051] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:20.385208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.385496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.385797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.418315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:20.420023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:20.430638 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1031/2052] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:20.436226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.461985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b72ad-ead4-4f01-9f99-d72c55349a7e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.469189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.470406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.470957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.471295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.472198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:20.472671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.498397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.528538 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1022/2053] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:20.533541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.547183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3d5d-ba3a-420a-a645-3f0c17ff5b29 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.555698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.556434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.556717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.556985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.560341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.562906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.594954 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1032/2054] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:20.599353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.609262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab42e-af4c-458a-b47d-fde11c41202d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.643641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:20.667490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.668178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.668447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.668717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.669348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.671236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.700240 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1023/2055] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:20.701661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.713573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e605-3600-4052-a63e-44645c47fa5b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.718446 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.719086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.719413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.719663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.720442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.722057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.735027 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1033/2056] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:20.739352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.750113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce81f5-d34b-4352-86ad-dace4d41ec2a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.756834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.757004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.757310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.757506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.758172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.760007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292bab5-de88-4677-9954-dc7e16b84c15 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.771726 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1024/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:20.775913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:20.786696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939565-514b-4d75-a523-59f132ca6d48 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:20.791545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:20.792245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.792523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.792869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] PATH_INFO: `/v3/projects/67f084c3d1d3432baef13cda51fbfb9c/users/2ade50198f7841ec865342b42739deb3/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.807809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f084c3d1d3432baef13cda51fbfb9c, user_id=2ade50198f7841ec865342b42739deb3, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:20.810505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:20.827512 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1034/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:20 2022] PUT /identity/v3/projects/67f084c3d1d3432baef13cda51fbfb9c/users/2ade50198f7841ec865342b42739deb3/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:20.839332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:20.839811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:20.839934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:20.872187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] MFA Rules not processed for user `2ade50198f7841ec865342b42739deb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:20.873417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:20.952852 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1025/2059] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:20.957072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.034588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4ed1-4415-4241-9281-533606e19f83 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.041224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.041838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.042109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.042879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.043166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.045621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.079783 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1035/2060] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:20 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:21.081139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.098369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc359c5-7807-4379-a9c9-9713672fddd7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.163941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.164543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.164832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.165143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.165799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.167768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.192225 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1026/2061] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:21 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:21.196500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.206909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d1b18-b745-4f05-9340-d4c8c3485cc8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.211639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.212341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.212701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.212976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.213631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.215249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.226894 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1036/2062] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:21.231153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.241683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f4c4-4cd7-4050-82a8-b7456061803e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.246505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.247223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.247498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.247773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] PATH_INFO: `/v3/projects/796e027b99274485b77301d685a2fc32/users/6d96a05883844a7fb51bd7adddd9cf2f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.263110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796e027b99274485b77301d685a2fc32, user_id=6d96a05883844a7fb51bd7adddd9cf2f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.265842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.279939 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1027/2063] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:21 2022] PUT /identity/v3/projects/796e027b99274485b77301d685a2fc32/users/6d96a05883844a7fb51bd7adddd9cf2f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:21.284082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.294895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267ee6-382e-4290-885d-d64433201311 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.351207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.351857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.352132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.352404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.353059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.354704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd81668-2bad-4840-8665-58c9e447141d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.365310 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1037/2064] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:21.370043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.381437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e965b9-9fa9-4720-a9f4-aa6ec5cc7860 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.387613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.388298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.388574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.388845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] PATH_INFO: `/v3/projects/796e027b99274485b77301d685a2fc32/users/6d96a05883844a7fb51bd7adddd9cf2f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.391069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796e027b99274485b77301d685a2fc32, user_id=6d96a05883844a7fb51bd7adddd9cf2f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.394068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.397793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:21.407250 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1028/2065] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:21 2022] PUT /identity/v3/projects/796e027b99274485b77301d685a2fc32/users/6d96a05883844a7fb51bd7adddd9cf2f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:21.418758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.419037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.419308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.433756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:21.449205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] MFA Rules not processed for user `6d96a05883844a7fb51bd7adddd9cf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:21.450427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:21.522566 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1038/2066] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:21.535664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.537718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:21.600166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a664e-8586-4c74-bc1a-d4ec5b3ba573 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.605009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.605145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.605385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.605742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.616090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.617533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.627351 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1029/2067] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:21.656874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.731777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b77673-66e5-4e75-a2a5-a4bc123ab038 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.736468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.737096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.737383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.737665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] PATH_INFO: `/v3/users/2ade50198f7841ec865342b42739deb3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.738831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ade50198f7841ec865342b42739deb3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.740797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.790151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ade50198f7841ec865342b42739deb3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:21.790890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ade50198f7841ec865342b42739deb3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:21.796181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.797538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:21.800064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ade50198f7841ec865342b42739deb3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:21.807664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ade50198f7841ec865342b42739deb3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:21.809537 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b38e6-196d-4da9-b549-0ad6a52346b9 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:21.813500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:21.814098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.814369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.814634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.816621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:21.820528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24b806b8-59ee-498c-8b12-89480af87360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ade50198f7841ec865342b42739deb3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:21.826810 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1039/2068] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:21 2022] DELETE /identity/v3/users/2ade50198f7841ec865342b42739deb3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:21.831730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:21.832233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:21.832503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:21.851165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:21.852372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:21.859834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:21.882552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:21.884257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:21.900050 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1030/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:21.931453 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1040/2070] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:21.941506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:21.943014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:22.015197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859c2c5-2389-45d6-9b64-4539decc5425 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:22.070652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:22.071557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:22.071930 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:22.072281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:22.080938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:22.083413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:22.085777 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:22.095721 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1031/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:22.454432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:22.455931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:22.482823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e1d1-cee8-499b-94d1-ccf6aeaa7e96 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:22.490009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:22.490661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:22.490989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:22.491195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] PATH_INFO: `/v3/projects/67f084c3d1d3432baef13cda51fbfb9c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:22.492374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f084c3d1d3432baef13cda51fbfb9c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:22.494314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:22.549466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f084c3d1d3432baef13cda51fbfb9c', 'request_id': 'req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.556931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f084c3d1d3432baef13cda51fbfb9c', 'request_id': 'req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.568801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f084c3d1d3432baef13cda51fbfb9c', 'request_id': 'req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.581969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] The token cache is being invalidate because project 67f084c3d1d3432baef13cda51fbfb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:22.583945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.583945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.597026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:22.598540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:22.603977 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1041/2072] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:22 2022] DELETE /identity/v3/projects/67f084c3d1d3432baef13cda51fbfb9c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:22.605409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:22.606925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:22.670102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65871b-67ae-472a-be56-5b5cd874ee26 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:22.726287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:22.727002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:22.727183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:22.727452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:22.729340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:22.732037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d89b7-9c2b-4b7e-ac73-e9f7b9ab0d53 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:22.738567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:22.739551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:22.739976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:22.740400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] PATH_INFO: `/v3/users/6d96a05883844a7fb51bd7adddd9cf2f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:22.741766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d96a05883844a7fb51bd7adddd9cf2f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:22.744732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:22.799951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:22.801562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:22.803668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:22.821320 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1032/2073] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:22.822646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d96a05883844a7fb51bd7adddd9cf2f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.823324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d96a05883844a7fb51bd7adddd9cf2f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.830799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d96a05883844a7fb51bd7adddd9cf2f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.838136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d96a05883844a7fb51bd7adddd9cf2f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.851018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b0fdb24e-845e-4476-ad98-cb5c51d7dfd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d96a05883844a7fb51bd7adddd9cf2f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:22.857663 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1042/2074] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:22 2022] DELETE /identity/v3/users/6d96a05883844a7fb51bd7adddd9cf2f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:23.212130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.226919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580db0a-adca-45df-b0c3-4f235a90fd60 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.296971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.297618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.297892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.298163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] PATH_INFO: `/v3/projects/796e027b99274485b77301d685a2fc32` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.299287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] RBAC: Authorizing `identity:delete_project(project_id=796e027b99274485b77301d685a2fc32)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.301912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.304325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:23.351060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796e027b99274485b77301d685a2fc32', 'request_id': 'req-be641560-06c7-404d-88ea-c4196806063e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:23.356484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796e027b99274485b77301d685a2fc32', 'request_id': 'req-be641560-06c7-404d-88ea-c4196806063e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:23.365901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796e027b99274485b77301d685a2fc32', 'request_id': 'req-be641560-06c7-404d-88ea-c4196806063e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:23.377544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] The token cache is being invalidate because project 796e027b99274485b77301d685a2fc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:23.378040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:23.378732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-be641560-06c7-404d-88ea-c4196806063e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:23.380394 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1033/2075] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:23 2022] DELETE /identity/v3/projects/796e027b99274485b77301d685a2fc32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:23.386291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.386571 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.386835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.407865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:23.409366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:23.470671 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1043/2076] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:23.478792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.479078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.479344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.499470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:23.500716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:23.509884 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1034/2077] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:23.515022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.524961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf888-7aa2-4fe3-b248-0f4dda51c98f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.531498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.532138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.532412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.533184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.533301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:23.533602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.535595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.548291 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1044/2078] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:10:23.553019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.563588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b293-fa3a-486a-a99b-2e0fcab8eed6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.569025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.569637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.569908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.570167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.570818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.572796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.605255 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1035/2079] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:23.606524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.617278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642c0b-2484-4e3a-8243-e54756913e83 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.678766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.679476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.679913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.680235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.680909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.682910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.711401 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1045/2080] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:23 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:23.712441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.727034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6700-d654-49a1-b98f-e21c47622fb5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.728605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.729242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.729520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.729799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.730448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.732106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.742826 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1036/2081] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:23.746985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.758076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd7aa7-ec48-4089-9f3b-e9e918e3b134 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.762824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.763461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.763775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.764065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.764700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.766294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372ca7a-8ee8-4b55-85a5-397c71772756 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.777994 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1046/2082] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:23.782498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.792818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6b-414d-4de7-80e6-b3d2b78ed232 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:23.797456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:23.798101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.798370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.798636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] PATH_INFO: `/v3/projects/b45fc7606eeb47cca7f9030f53b0d475/users/8992921b446148769feb5779de372326/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.813243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45fc7606eeb47cca7f9030f53b0d475, user_id=8992921b446148769feb5779de372326, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:23.816392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:23.829830 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1037/2083] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:23 2022] PUT /identity/v3/projects/b45fc7606eeb47cca7f9030f53b0d475/users/8992921b446148769feb5779de372326/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:23.841504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:23.841787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:23.842056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:23.870271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] MFA Rules not processed for user `8992921b446148769feb5779de372326`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:23.871464 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:23.881216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:23.944133 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1047/2084] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:23.956884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:23.959839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:24.064056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374e191-6ab4-45a9-8285-4e3daf2f5a74 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:24.068663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:24.069311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:24.069585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:24.069854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:24.078310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:24.079766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b514-1d43-4cec-ab18-ec5762e417b0 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:24.093920 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1038/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:26.792256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:26.793962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:26.875279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68428a1-defa-4c31-9fa9-d1a23d1068c0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:26.882923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:26.883573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:26.883898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:26.884220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] PATH_INFO: `/v3/users/cad4d1c54b64427cab8c21470a333541` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:26.885417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad4d1c54b64427cab8c21470a333541)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:26.887406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:26.952525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad4d1c54b64427cab8c21470a333541'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:26.953118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad4d1c54b64427cab8c21470a333541'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:26.964458 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad4d1c54b64427cab8c21470a333541'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:26.971688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad4d1c54b64427cab8c21470a333541'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:26.984521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad4d1c54b64427cab8c21470a333541'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:26.991779 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1048/2086] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:26 2022] DELETE /identity/v3/users/cad4d1c54b64427cab8c21470a333541 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:26.995553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:26.996104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:26.996213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:27.018710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:27.020325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:27.026574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:27.088616 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1039/2087] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:27.098704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:27.100241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:27.140321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:27.171839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c713-92b2-44d8-8581-41f7b5bdf056 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:27.175463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:27.176095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:27.176392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:27.176842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:27.186549 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:27.188048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:27.199896 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1049/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:27.573597 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:27.575155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:27.589772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4299dc-8fff-431f-b3ec-554e09a1a8b4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:27.606626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:27.607348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:27.607811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:27.608035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] PATH_INFO: `/v3/projects/96146e4bde3246e3a7d9c2de2681061a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:27.609589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96146e4bde3246e3a7d9c2de2681061a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:27.611711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:27.662131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96146e4bde3246e3a7d9c2de2681061a', 'request_id': 'req-393af37d-cbdb-4064-8b67-33721df0509e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.667811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96146e4bde3246e3a7d9c2de2681061a', 'request_id': 'req-393af37d-cbdb-4064-8b67-33721df0509e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.678806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96146e4bde3246e3a7d9c2de2681061a', 'request_id': 'req-393af37d-cbdb-4064-8b67-33721df0509e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.690568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] The token cache is being invalidate because project 96146e4bde3246e3a7d9c2de2681061a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:27.690853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.691501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.693223 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1040/2089] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:27 2022] DELETE /identity/v3/projects/96146e4bde3246e3a7d9c2de2681061a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:27.697416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:27.707224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6221b80-cf28-4b09-894e-13839c762eef service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:27.776420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:27.777128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:27.777429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:27.777707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] PATH_INFO: `/v3/users/2d3480d3adf447cbab225a7c886d4497` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:27.778879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3480d3adf447cbab225a7c886d4497)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:27.780846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:27.833844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3480d3adf447cbab225a7c886d4497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.834649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3480d3adf447cbab225a7c886d4497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.842197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3480d3adf447cbab225a7c886d4497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.849614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3480d3adf447cbab225a7c886d4497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.861474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3480d3adf447cbab225a7c886d4497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:27.867540 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1050/2090] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:27 2022] DELETE /identity/v3/users/2d3480d3adf447cbab225a7c886d4497 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:28.189580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:28.191466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:28.211315 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af37d-cbdb-4064-8b67-33721df0509e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:28.274298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:28.274861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:28.275133 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:28.275397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] PATH_INFO: `/v3/projects/22c174a6be404de79bbda7be694f4864` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:28.276553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c174a6be404de79bbda7be694f4864)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:28.278521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:28.324320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:28.336091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c174a6be404de79bbda7be694f4864', 'request_id': 'req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.342081 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c174a6be404de79bbda7be694f4864', 'request_id': 'req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.351733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c174a6be404de79bbda7be694f4864', 'request_id': 'req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.364885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] The token cache is being invalidate because project 22c174a6be404de79bbda7be694f4864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:28.365175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.365832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.367333 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1041/2091] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:28 2022] DELETE /identity/v3/projects/22c174a6be404de79bbda7be694f4864 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:28.371348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:28.372787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:28.385599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541de2-39e8-4db0-a1d7-b9c45a4010b5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:28.437448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:28.450363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:28.451004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:28.451277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:28.451545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] PATH_INFO: `/v3/users/1d65181a12294a619ee0a9985c75b267` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:28.452738 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d65181a12294a619ee0a9985c75b267)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:28.454675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:28.510508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d65181a12294a619ee0a9985c75b267'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.511158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d65181a12294a619ee0a9985c75b267'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.525400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d65181a12294a619ee0a9985c75b267'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.539215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d65181a12294a619ee0a9985c75b267'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.553079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-31b22f00-a4ff-455a-9b48-e7d119acaee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d65181a12294a619ee0a9985c75b267'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:28.562892 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1051/2092] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:28 2022] DELETE /identity/v3/users/1d65181a12294a619ee0a9985c75b267 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:29.130772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.132825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:29.149950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7dde-a6b9-443c-9fb8-6dee215a9a49 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.210886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.211532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.211788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.212064 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] PATH_INFO: `/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.213195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf35bf5c206c4bc2a117bedbd85de67f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.215088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.262681 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf35bf5c206c4bc2a117bedbd85de67f', 'request_id': 'req-59573504-efbf-44b6-8351-76b691b73cca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:29.268650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf35bf5c206c4bc2a117bedbd85de67f', 'request_id': 'req-59573504-efbf-44b6-8351-76b691b73cca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:29.277688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf35bf5c206c4bc2a117bedbd85de67f', 'request_id': 'req-59573504-efbf-44b6-8351-76b691b73cca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:29.291923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] The token cache is being invalidate because project cf35bf5c206c4bc2a117bedbd85de67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:29.292216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:29.292989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59573504-efbf-44b6-8351-76b691b73cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:29.294983 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1042/2093] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:29 2022] DELETE /identity/v3/projects/cf35bf5c206c4bc2a117bedbd85de67f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:29.300343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.300927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.300927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.322799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:29.324073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:29.391523 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1052/2094] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:29.400356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.400661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.400926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.422101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:29.423349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:29.432316 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1043/2095] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:29.437545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.448122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315660f-8660-4c41-94aa-300cd95f2ff9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.453203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.453968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.454231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.454503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.455255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:29.455572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.457367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.474893 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1053/2096] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:29.476139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.485782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910efde5-070d-49d6-873d-5ee22a3ffda6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.491354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.492327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.492327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.492543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.493416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.495533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.527882 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1044/2097] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:29 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:29.536836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.548026 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896f37-ce95-46fe-962b-6c5491baa681 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.600429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:29.608985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.610036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.610479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.610795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.611685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.614238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.637339 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1054/2098] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:29 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:29.641696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.652387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091329c-5b88-4ed9-a145-dd9ec13c2c83 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.657402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.657995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.658272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.658543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.659197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.661385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.671659 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1045/2099] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:29.675842 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.686602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f7dd-d051-4da6-b74b-fb8bb0cda960 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.691418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.692085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.692368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.692664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.693340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.695017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b4c3-b0b4-4aa7-bdf8-589b360e382a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.706338 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1055/2100] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:29.711124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.721602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9d79-f22a-429b-b6c9-a6f01123e4cf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.727574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.728263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.728590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.728906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] PATH_INFO: `/v3/projects/bab98f4842584867864f1e6af67a1f70/users/f5e3e658bdaf4c33baab2d8519d53a76/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.742430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:29.746074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab98f4842584867864f1e6af67a1f70, user_id=f5e3e658bdaf4c33baab2d8519d53a76, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.749429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.765131 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1046/2101] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:29 2022] PUT /identity/v3/projects/bab98f4842584867864f1e6af67a1f70/users/f5e3e658bdaf4c33baab2d8519d53a76/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:29.770304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f9417-a7bc-4d17-9822-11f52e426194 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.771053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f9417-a7bc-4d17-9822-11f52e426194 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.771053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f9417-a7bc-4d17-9822-11f52e426194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.791005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f37f9417-a7bc-4d17-9822-11f52e426194 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:29.792255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f37f9417-a7bc-4d17-9822-11f52e426194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:29.854746 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1056/2102] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:29.865571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:29.867494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:29.943993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434f255-d9ae-4be2-aab2-83197f1d0d18 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:29.947967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:29.948581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:29.948854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:29.949126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:29.962323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:29.963792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:29.974888 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1047/2103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:30.047982 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e6fd-8e22-4b2b-a01e-516e26eee826 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:30.048540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e6fd-8e22-4b2b-a01e-516e26eee826 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:30.048832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e6fd-8e22-4b2b-a01e-516e26eee826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:30.071015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0846e6fd-8e22-4b2b-a01e-516e26eee826 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:30.072635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0846e6fd-8e22-4b2b-a01e-516e26eee826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:30.150666 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1057/2104] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:30.221266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:30.225356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:30.335091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1a8d-c74c-4ea3-b077-24e77f86074d service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:30.362635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:30.363389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:30.363708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:30.364176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:30.375426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:30.377877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:30.390271 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1048/2105] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:10:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:10:30.731127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152077d-85bb-4428-8c9b-ececb68476e4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:30.731648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152077d-85bb-4428-8c9b-ececb68476e4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:30.731648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152077d-85bb-4428-8c9b-ececb68476e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:30.767291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7152077d-85bb-4428-8c9b-ececb68476e4 None None] MFA Rules not processed for user `f5e3e658bdaf4c33baab2d8519d53a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:30.768647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7152077d-85bb-4428-8c9b-ececb68476e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:30.877394 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1058/2106] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:30.894417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:30.900023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:30.976278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e032-9309-42cc-9b92-f537cc424caf service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:30.986706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:30.987603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:30.987918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:30.988196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:30.998320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:30.999931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:31.013727 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1049/2107] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:31.051814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7e2a-b2e5-4c85-a218-933ce025681e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.052172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7e2a-b2e5-4c85-a218-933ce025681e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.052443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7e2a-b2e5-4c85-a218-933ce025681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.072448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fffe7e2a-b2e5-4c85-a218-933ce025681e None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:31.074390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fffe7e2a-b2e5-4c85-a218-933ce025681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.085544 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1059/2108] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:31.098583 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:31.111125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870602-2a53-4a8a-b03f-de2ae20b0ec1 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:31.116551 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:31.117162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.117432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.117695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.126487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:31.128456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:31.137094 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1050/2109] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:10:31.432836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.433215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.433644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.438544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:31.439986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.444620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:31.455203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06158-48f6-42ee-a8d8-3ad000a5903a service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:31.461458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:31.462143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.462416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.462759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] PATH_INFO: `/v3/users/1db30ccdf3a44691b6d00735f47b5645` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.463928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db30ccdf3a44691b6d00735f47b5645)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:31.465841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:31.466525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:31.467755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.473528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:31.476091 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1060/2110] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:31.488772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:31.502033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc2fc5-4d71-4a6b-bd30-c4f15c589001 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:31.509351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:31.510351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.510853 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.511337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.519999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db30ccdf3a44691b6d00735f47b5645'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:31.523093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:31.524740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61ffef-060e-463b-b7a2-9fcf8851253f service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:31.533387 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1061/2111] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:10:31.533540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db30ccdf3a44691b6d00735f47b5645'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:31.542232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db30ccdf3a44691b6d00735f47b5645'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:31.542944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db30ccdf3a44691b6d00735f47b5645'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:31.543628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db30ccdf3a44691b6d00735f47b5645'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:31.556628 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1051/2112] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:31 2022] DELETE /identity/v3/users/1db30ccdf3a44691b6d00735f47b5645 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:31.561374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7123fa-2802-46fc-b543-dc37df3e1399 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.561608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7123fa-2802-46fc-b543-dc37df3e1399 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.561863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7123fa-2802-46fc-b543-dc37df3e1399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.581173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3f7123fa-2802-46fc-b543-dc37df3e1399 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:31.582367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3f7123fa-2802-46fc-b543-dc37df3e1399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.643814 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1062/2113] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:31.653680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:31.655194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.720213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842703fd-ffb6-4b81-afe4-b50b99077250 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:31.724318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:31.724929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.725200 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.725466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.734477 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:31.735934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:31.746553 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1052/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:31.870740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:31.870740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:31.871453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:31.891651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:31.892804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:31.958957 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1063/2115] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:31.972294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:31.973973 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:32.048257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:32.049710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:32.057505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14587-eba0-464f-8bc8-b80cff9418f5 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:32.063126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:32.064118 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:32.068949 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:32.069170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082576ca-9ccb-4324-ab02-c7051e95fc54 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:32.069749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:32.078391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:32.079107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:32.080700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:32.081205 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] PATH_INFO: `/v3/projects/96c83f6ffbae494d837dd8ecf246f8d8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:32.083193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c83f6ffbae494d837dd8ecf246f8d8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:32.085605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:32.090907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:32.092573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:32.101501 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1053/2116] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:10:32.154938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c83f6ffbae494d837dd8ecf246f8d8', 'request_id': 'req-1a872999-92ca-43f9-8810-21082fe91af8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.164666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c83f6ffbae494d837dd8ecf246f8d8', 'request_id': 'req-1a872999-92ca-43f9-8810-21082fe91af8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.174230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c83f6ffbae494d837dd8ecf246f8d8', 'request_id': 'req-1a872999-92ca-43f9-8810-21082fe91af8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.192274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] The token cache is being invalidate because project 96c83f6ffbae494d837dd8ecf246f8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:32.192744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.193751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a872999-92ca-43f9-8810-21082fe91af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.195449 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1064/2117] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:32 2022] DELETE /identity/v3/projects/96c83f6ffbae494d837dd8ecf246f8d8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:32.199640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:32.212735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde62aa-031e-450a-8648-2a4678aa25f7 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:32.233122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:32.296422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:32.297175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:32.297556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:32.297917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] PATH_INFO: `/v3/users/fd04457b01b54da3a4d99634ace9b0b3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:32.299413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd04457b01b54da3a4d99634ace9b0b3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:32.302805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:32.368235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd04457b01b54da3a4d99634ace9b0b3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.393190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd04457b01b54da3a4d99634ace9b0b3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.407488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd04457b01b54da3a4d99634ace9b0b3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.408170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd04457b01b54da3a4d99634ace9b0b3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.408840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd04457b01b54da3a4d99634ace9b0b3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:32.429452 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1054/2118] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:32 2022] DELETE /identity/v3/users/fd04457b01b54da3a4d99634ace9b0b3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:32.564805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42015-50cb-4446-af04-544e37a1244d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:32.565097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42015-50cb-4446-af04-544e37a1244d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:32.565363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42015-50cb-4446-af04-544e37a1244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:32.598142 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-91e42015-50cb-4446-af04-544e37a1244d None None] MFA Rules not processed for user `f5e3e658bdaf4c33baab2d8519d53a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:32.599610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-91e42015-50cb-4446-af04-544e37a1244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:32.617155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:32.708718 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1065/2119] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:32.949392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:32.952415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:33.055673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe33c1-43e0-4b5f-a172-3ae0e7ae65c2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.063789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.064520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.064925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.065127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] PATH_INFO: `/v3/projects/d53137d08c174935b680f6818b75fcd6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.068779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53137d08c174935b680f6818b75fcd6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.072928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.142296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:33.170230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53137d08c174935b680f6818b75fcd6', 'request_id': 'req-34ad7501-6c00-475c-a9b5-8a00b4ca8889'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:33.180864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53137d08c174935b680f6818b75fcd6', 'request_id': 'req-34ad7501-6c00-475c-a9b5-8a00b4ca8889'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:33.194921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53137d08c174935b680f6818b75fcd6', 'request_id': 'req-34ad7501-6c00-475c-a9b5-8a00b4ca8889'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:33.213035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] The token cache is being invalidate because project d53137d08c174935b680f6818b75fcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:33.213458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:33.214237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-34ad7501-6c00-475c-a9b5-8a00b4ca8889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:33.220325 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1055/2120] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:32 2022] DELETE /identity/v3/projects/d53137d08c174935b680f6818b75fcd6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:33.222168 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.222935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.222935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.247512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:33.249061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:33.359574 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1066/2121] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:33.370393 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.370672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.371015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.405944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:33.407157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:33.423797 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1056/2122] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:33.428451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.439823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9794a2-077b-4f68-a953-08ae9621dd50 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.445575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.446199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.446460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.446729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.447384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:33.447683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.449343 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.467778 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1067/2123] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:33.472406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.486194 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee6b-bfee-4110-8752-75595dd2c4b7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.505875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.506725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.507004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.507269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.508132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.510072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.555672 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1057/2124] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:33.560799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.579659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea43a0-5436-4ca9-b1d8-70cd377ff409 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.651419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.652286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.652556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.652822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.653459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.655409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.681224 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1068/2125] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:33.685322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.697049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b1b1-191d-4416-8e83-dd4c3229dcc4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.702984 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.703955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.704365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.704633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.705385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.707238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.719817 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1058/2126] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:33.722819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.734013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734449-d45b-4850-8d1f-e4c0b3b9fb7f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.740872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.741532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.741817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.742135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.742945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.744770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeadda-fa30-4f5c-9da6-c985edc90cff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.758269 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1069/2127] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:33.762599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:33.773577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963856-5d75-429c-b65b-6e09c0e5d0ae admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:33.778311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:33.778982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.779254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.779525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] PATH_INFO: `/v3/projects/dbc539ec1a9a4fe69efe55fff654883e/users/225d17c599094705b723dc11a67bb777/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.800625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc539ec1a9a4fe69efe55fff654883e, user_id=225d17c599094705b723dc11a67bb777, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:33.803672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:33.825463 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1059/2128] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:33 2022] PUT /identity/v3/projects/dbc539ec1a9a4fe69efe55fff654883e/users/225d17c599094705b723dc11a67bb777/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:33.836366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:33.836366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:33.836673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:33.866939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] MFA Rules not processed for user `225d17c599094705b723dc11a67bb777`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:33.868607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:33.883559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:33.949806 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1070/2129] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:33.954544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.031640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30d0-9ae9-49b6-905c-dfae727f5ca8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.036841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.037459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.037908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.038183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.038814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.040926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.075571 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1060/2130] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:33 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:34.079587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.090823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f71f8-6871-4dbf-820d-3fdc2acd2313 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.160877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.161592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.161966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.162301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.163018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.165229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.197801 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1071/2131] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:34 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:34.199278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.211686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf1d7-3ac9-47d6-a0ff-72cdf4564610 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.217241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.217857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.218165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.218394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.219076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.220684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.231912 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1061/2132] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:34.236311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.248386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749e440-4499-49ad-a8df-2eb7367a45de admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.253770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.254772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.255173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.255490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] PATH_INFO: `/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c/users/e8e5b1f4d2a844379bdf99fe75f7ce9d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.271024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] RBAC: Authorizing `identity:create_grant(project_id=5285ef6a17af4ef6beaeba11da4cfe5c, user_id=e8e5b1f4d2a844379bdf99fe75f7ce9d, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.273973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.292206 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1072/2133] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:34 2022] PUT /identity/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c/users/e8e5b1f4d2a844379bdf99fe75f7ce9d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:34.293797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.304960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cb99b-6593-45d3-926b-cc46819a879a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.341849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:34.367271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.367910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.368184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.368448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.369111 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.370762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85252ca6-ce35-48a7-adb1-36d0f1e4483a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.383785 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1062/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:34.385019 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.396059 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c646fe-a044-4358-bef1-2acddf93dace admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.400753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.401411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.401681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.401944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] PATH_INFO: `/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c/users/e8e5b1f4d2a844379bdf99fe75f7ce9d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.403926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5285ef6a17af4ef6beaeba11da4cfe5c, user_id=e8e5b1f4d2a844379bdf99fe75f7ce9d, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.406602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.417477 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1073/2135] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:34 2022] PUT /identity/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c/users/e8e5b1f4d2a844379bdf99fe75f7ce9d/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:34.428511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.428712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.429112 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.458573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] MFA Rules not processed for user `e8e5b1f4d2a844379bdf99fe75f7ce9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:34.459815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:34.530687 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1063/2136] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:34.544586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.546574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:34.608612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef9cf-0fee-45dc-973d-39436cbdec15 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.613313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.613997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.614339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.614664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.629696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:34.631496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:34.639204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:34.695376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.696984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73354fed-5af4-4f47-8180-623fdb823f25 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.707348 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1074/2137] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:34.737075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0bfc-e0ab-4d71-8644-de303192c954 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:34.742644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:34.743307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.743578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.743908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] PATH_INFO: `/v3/users/728c234a3b9b4e9a9235b609fbf0ee13` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.745116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728c234a3b9b4e9a9235b609fbf0ee13)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:34.747034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:34.806857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728c234a3b9b4e9a9235b609fbf0ee13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:34.817652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:34.820301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728c234a3b9b4e9a9235b609fbf0ee13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:34.840387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728c234a3b9b4e9a9235b609fbf0ee13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:34.841490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728c234a3b9b4e9a9235b609fbf0ee13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:34.842524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728c234a3b9b4e9a9235b609fbf0ee13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:34.863243 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1064/2138] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:34 2022] DELETE /identity/v3/users/728c234a3b9b4e9a9235b609fbf0ee13 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:34.865072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:34.865363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:34.865659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:34.892201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:34.893614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:34.990598 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1075/2139] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:35.001769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.003319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:35.087307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4d53d-aec6-46dd-9a0a-27bcde4dc5f4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.093750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.095274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.095645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.095947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.107554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.109849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd07b-99cc-4806-bf61-bbe11b2f6291 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.133389 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1065/2140] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:35.343764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.345964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:35.380763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0b83-bc84-4f27-aa85-14b5200d7e7c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.385272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.385908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.386182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.386975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] PATH_INFO: `/v3/projects/50a921de7b2b4dd9ae0c70e414920c1f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.388136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a921de7b2b4dd9ae0c70e414920c1f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.390083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.440316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a921de7b2b4dd9ae0c70e414920c1f', 'request_id': 'req-dfb1d8a6-277d-481c-980b-c77298940497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:35.446867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a921de7b2b4dd9ae0c70e414920c1f', 'request_id': 'req-dfb1d8a6-277d-481c-980b-c77298940497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:35.454750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a921de7b2b4dd9ae0c70e414920c1f', 'request_id': 'req-dfb1d8a6-277d-481c-980b-c77298940497'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:35.468052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] The token cache is being invalidate because project 50a921de7b2b4dd9ae0c70e414920c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:35.468341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:35.469104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dfb1d8a6-277d-481c-980b-c77298940497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:35.474658 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1076/2141] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:35 2022] DELETE /identity/v3/projects/50a921de7b2b4dd9ae0c70e414920c1f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:35.476731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.477102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.477438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.498318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:35.499653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:35.561302 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1066/2142] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:35.570374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.570541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.570796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.591235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:35.592476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:35.601007 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1077/2143] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:35.605460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.615998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672bb0-8bae-462c-98a2-75f569361684 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.620720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.621426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.621766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.622039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.622688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:35.623043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.624657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.636619 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1067/2144] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:35.640990 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.651539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553bdf0-5db8-4577-b19d-63322f0febe2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.656603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.657340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.657783 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.658141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.658866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.661680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.704307 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1078/2145] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:35 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:35.710088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.721054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74df2f-d52a-481d-8859-6ccc53b5f5eb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.794252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.794879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.795160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.795440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.796119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.799270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.818367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:35.825985 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1068/2146] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:35 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:35.830083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.845609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508dfc1-c4fe-43f1-9667-68139229d203 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.850568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.851194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.851471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.851773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.852433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.854110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.865398 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1079/2147] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:35.869480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.880873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2711d3-46bc-4bd4-81a8-5764f9830f7b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.886463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.887083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.887361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.887680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.888377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.889988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965c16-eedc-4f32-9ab4-f4b5a67aa266 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.905537 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1069/2148] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:35.906983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:35.920788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:35.926301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6517f-1267-4dfc-905e-81ad69e66520 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:35.933340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:35.934181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.934800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.935492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] PATH_INFO: `/v3/projects/32e99155532848e7a1de0895210c841d/users/2eae4549c0684372af1e4fa3d68fe529/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:35.952915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e99155532848e7a1de0895210c841d, user_id=2eae4549c0684372af1e4fa3d68fe529, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:35.955554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:35.973600 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1080/2149] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:35 2022] PUT /identity/v3/projects/32e99155532848e7a1de0895210c841d/users/2eae4549c0684372af1e4fa3d68fe529/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:35.981069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:35.981069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:35.981450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:36.001821 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:36.002386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:36.065966 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1070/2150] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:36.075809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:36.077539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:36.147055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20b1a7-eb00-4cbb-b437-eb8af00ab583 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:36.151309 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:36.151951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:36.152359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:36.152632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:36.167933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:36.169574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:36.181138 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1081/2151] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:36.206305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:36.208351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:36.274553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67e83-b262-4a4b-9a4a-ee560b48d056 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:36.282142 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:36.283052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:36.283299 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:36.283705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:36.286772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:36.471572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:36.474431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0089b3-e4f4-42bf-afb4-584520fa67df service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:36.485837 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1071/2152] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:40.824154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:40.826647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:40.876481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731763d3-f801-495f-aaa6-5e2fb565be9b service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:40.893355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:40.894179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:40.894902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:40.895450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] PATH_INFO: `/v3/users/225d17c599094705b723dc11a67bb777` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:40.897848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] RBAC: Authorizing `identity:delete_user(user_id=225d17c599094705b723dc11a67bb777)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:40.899852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:40.966622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225d17c599094705b723dc11a67bb777'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:40.967298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225d17c599094705b723dc11a67bb777'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:40.976654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225d17c599094705b723dc11a67bb777'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:40.985022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225d17c599094705b723dc11a67bb777'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.005110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225d17c599094705b723dc11a67bb777'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.018887 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1082/2153] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:40 2022] DELETE /identity/v3/users/225d17c599094705b723dc11a67bb777 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:41.021947 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2046-9eb9-40c5-9dda-2d25778db12e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.022527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2046-9eb9-40c5-9dda-2d25778db12e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.023708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2046-9eb9-40c5-9dda-2d25778db12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.062198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-53bb2046-9eb9-40c5-9dda-2d25778db12e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:41.066190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-53bb2046-9eb9-40c5-9dda-2d25778db12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.113793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:41.153760 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1072/2154] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:41.166004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:41.168003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.259543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b888b-1b42-406e-be7d-1a86e8cc807c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:41.277770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:41.278651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.279038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.279406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.302711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:41.304508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:41.309017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:41.319135 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1083/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:41.624735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.625026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.625298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.682926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] MFA Rules not processed for user `2eae4549c0684372af1e4fa3d68fe529`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:41.684215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.718068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:41.719406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.740435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcb32-e828-4533-a313-4e764567a934 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:41.745940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:41.746759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.747180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.747565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] PATH_INFO: `/v3/projects/dbc539ec1a9a4fe69efe55fff654883e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.749066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc539ec1a9a4fe69efe55fff654883e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:41.751414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:41.788073 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1073/2156] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:41.789174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:41.791911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.822651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6caf3-3bf5-4c09-963c-454cb1539f54 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:41.827712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc539ec1a9a4fe69efe55fff654883e', 'request_id': 'req-a486a083-5643-4cbb-9342-a25292f257c9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.834120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc539ec1a9a4fe69efe55fff654883e', 'request_id': 'req-a486a083-5643-4cbb-9342-a25292f257c9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.854034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc539ec1a9a4fe69efe55fff654883e', 'request_id': 'req-a486a083-5643-4cbb-9342-a25292f257c9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.871594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] The token cache is being invalidate because project dbc539ec1a9a4fe69efe55fff654883e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:41.871930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.872575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:41.877554 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1084/2157] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:41 2022] DELETE /identity/v3/projects/dbc539ec1a9a4fe69efe55fff654883e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:41.878815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:41.880324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:41.921521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:41.922490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.922938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.923409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.924614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:41.929912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:41.975056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a083-5643-4cbb-9342-a25292f257c9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:41.980063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:41.980786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:41.981119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:41.981447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] PATH_INFO: `/v3/users/e8e5b1f4d2a844379bdf99fe75f7ce9d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:41.982959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e5b1f4d2a844379bdf99fe75f7ce9d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:41.983093 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1074/2158] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:41.986766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:41.987922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:41.995819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:42.089540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e5b1f4d2a844379bdf99fe75f7ce9d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.090690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e5b1f4d2a844379bdf99fe75f7ce9d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.100912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e5b1f4d2a844379bdf99fe75f7ce9d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.124803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e5b1f4d2a844379bdf99fe75f7ce9d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.130518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:42.138923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0b340-bb9f-441f-9000-0c4547cc9313 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.143315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e5b1f4d2a844379bdf99fe75f7ce9d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.146784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:42.155288 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1085/2159] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:41 2022] DELETE /identity/v3/users/e8e5b1f4d2a844379bdf99fe75f7ce9d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:42.163981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.164806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.164985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.165270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.168060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.169936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.206794 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1075/2160] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:41 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:42.215086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:42.216999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:42.328528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5db49-5adc-4d86-b14e-d26a2576f62d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.335728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.336770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.337070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.337572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.338293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.340546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.362303 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1086/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:42.367649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:42.379451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a3bc0-f0a9-4a62-be91-989b516faf10 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.385833 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.386806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.387313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.387795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] PATH_INFO: `/v3/projects/6af3023818cc4d1b8d2924b7f3294c01/users/f502d27c3e994141bed8fd464f598e83/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.421577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af3023818cc4d1b8d2924b7f3294c01, user_id=f502d27c3e994141bed8fd464f598e83, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.438640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.460959 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1076/2162] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:42 2022] PUT /identity/v3/projects/6af3023818cc4d1b8d2924b7f3294c01/users/f502d27c3e994141bed8fd464f598e83/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:42.462730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:42.478584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0517-fa01-4510-a467-665b04b5cb69 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.545212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.545957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.546322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.546656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.547455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.549364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.560786 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1087/2163] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:42.564721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:42.576183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ee8-0047-4e9f-9297-d8df7713b337 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.581075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.581847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.582742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.583122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] PATH_INFO: `/v3/projects/6af3023818cc4d1b8d2924b7f3294c01/users/f502d27c3e994141bed8fd464f598e83/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.585252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af3023818cc4d1b8d2924b7f3294c01, user_id=f502d27c3e994141bed8fd464f598e83, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.588282 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce75b-9470-4155-9b78-11184b07e849 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.600508 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1077/2164] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:42 2022] PUT /identity/v3/projects/6af3023818cc4d1b8d2924b7f3294c01/users/f502d27c3e994141bed8fd464f598e83/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:42.642599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:42.645119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:42.661342 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4fa3-01ab-4263-bb23-3d8b4f1980a8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:42.746701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:42.747438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.747659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.747957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] PATH_INFO: `/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.749135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5285ef6a17af4ef6beaeba11da4cfe5c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:42.751107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:42.803997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:42.816267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5285ef6a17af4ef6beaeba11da4cfe5c', 'request_id': 'req-82304c68-4c19-43fa-9e54-e3b2e9646e83'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.822923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5285ef6a17af4ef6beaeba11da4cfe5c', 'request_id': 'req-82304c68-4c19-43fa-9e54-e3b2e9646e83'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.833627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5285ef6a17af4ef6beaeba11da4cfe5c', 'request_id': 'req-82304c68-4c19-43fa-9e54-e3b2e9646e83'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.848710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] The token cache is being invalidate because project 5285ef6a17af4ef6beaeba11da4cfe5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:42.849238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.850367 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-82304c68-4c19-43fa-9e54-e3b2e9646e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:42.852519 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1088/2165] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:42 2022] DELETE /identity/v3/projects/5285ef6a17af4ef6beaeba11da4cfe5c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:42.858009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:42.858274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:42.858552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:42.897239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:42.898577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:43.012079 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1078/2166] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:43.019904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.020112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.020436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.041552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:43.043101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:43.051778 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1089/2167] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:43.055986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.076469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261933c5-bf5c-414d-816c-cc0ea27b049c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.081919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.082665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.083182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.083586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.084388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:43.084807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.087164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.104145 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1079/2168] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:10:43.107529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.128412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0cdd-7855-4dad-b30b-1ae7ff8b77e5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.134896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.135645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.136115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.136613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.137195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.139371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.173938 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1090/2169] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:43.178487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.189879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbe927-fd50-44fe-b820-b2edf16c79cc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.259321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.259990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.260351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.260689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.262078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.265374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.299877 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1080/2170] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:43.301123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.312167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24cfb-f529-4311-aea7-37c865d43109 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.317718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.318323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.318598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.319145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.319514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.321304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.336135 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1091/2171] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:43.337522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.349004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296ab0-65f0-4684-b507-5127a014bfe7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.353905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.354557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.354835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.355182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.355873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.357745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d11c3-1a4f-44ba-8e86-092d0bc0cb41 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.375132 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1081/2172] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:43.380295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.393152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f81bd2-a417-41c3-a12b-225e7043c78f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.399868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.400747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.401177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.402165 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] PATH_INFO: `/v3/projects/45c7b982bbff42e0a34031bb72f63fab/users/78fa91a22923435586e0b94d66d1272d/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.425170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c7b982bbff42e0a34031bb72f63fab, user_id=78fa91a22923435586e0b94d66d1272d, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.428520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.449095 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1092/2173] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:43 2022] PUT /identity/v3/projects/45c7b982bbff42e0a34031bb72f63fab/users/78fa91a22923435586e0b94d66d1272d/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:43.460139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.460319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.460592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.489005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:43.500404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] MFA Rules not processed for user `78fa91a22923435586e0b94d66d1272d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:43.502664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:43.662357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.665250 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1082/2174] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:43.748025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc20279-16ae-45b5-b7f3-7811efa6bda2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.753438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.754607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.755015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.755291 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.755977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.758886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.805873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.815147 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1093/2175] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:43.822338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e0c53-5eac-4a1c-bd18-7ce40716879b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.898409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.899041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.899321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.899594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.900678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.903226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:43.938867 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1083/2176] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:43 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:43.943661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:43.959949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270e70-0bb7-4543-a3f7-288f26595445 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:43.966501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:43.970387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:43.970973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:43.971339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:43.972374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:43.976830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:44.000017 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1094/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:44.006525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:44.027408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56c9d-2c9f-4b55-8c32-d2a925a9ca34 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:44.035145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:44.036229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:44.036997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:44.037345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] PATH_INFO: `/v3/projects/e5a310612b104b7d880332e979e870a0/users/bc2bec4f96194919900e5f03614be662/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:44.059380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a310612b104b7d880332e979e870a0, user_id=bc2bec4f96194919900e5f03614be662, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:44.065052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:44.105206 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1084/2178] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:44 2022] PUT /identity/v3/projects/e5a310612b104b7d880332e979e870a0/users/bc2bec4f96194919900e5f03614be662/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:44.110154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:44.121375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e86a-599e-4f20-96a4-70493881617b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:44.207526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:44.273179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:44.273820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:44.276537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:44.276826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:44.277523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:44.283323 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4cb9b-ab36-4767-b46e-9e76d2ce390f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:44.310112 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1095/2179] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:44.314436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:44.332154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823b66-a5b2-4fc7-b3e8-d2b228d354aa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:44.343644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:44.344492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:44.344788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:44.345104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] PATH_INFO: `/v3/projects/e5a310612b104b7d880332e979e870a0/users/bc2bec4f96194919900e5f03614be662/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:44.347680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a310612b104b7d880332e979e870a0, user_id=bc2bec4f96194919900e5f03614be662, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:44.351026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:44.377115 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1085/2180] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:44 2022] PUT /identity/v3/projects/e5a310612b104b7d880332e979e870a0/users/bc2bec4f96194919900e5f03614be662/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:44.388465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:44.389032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:44.389454 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:44.447410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] MFA Rules not processed for user `bc2bec4f96194919900e5f03614be662`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:44.448896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:44.558805 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1096/2181] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:44.574647 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:44.576554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:44.693280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e32637-704c-4290-a089-bcbe874de8bc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:44.699037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:44.699958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:44.700433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:44.700918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:44.716301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:44.729276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:44.733140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415e4c2-8a6b-4d67-980a-5c2a5d6fffc3 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:44.755120 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1086/2182] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:44.848796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:45.027221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001250-3dee-4885-8d54-3d6181f85ad2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:45.035371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:45.036270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:45.037362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:45.037362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] PATH_INFO: `/v3/users/78fa91a22923435586e0b94d66d1272d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:45.046535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78fa91a22923435586e0b94d66d1272d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:45.048613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:45.189805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78fa91a22923435586e0b94d66d1272d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:45.192060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78fa91a22923435586e0b94d66d1272d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:45.220270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78fa91a22923435586e0b94d66d1272d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:45.222984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:45.237874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78fa91a22923435586e0b94d66d1272d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:45.274614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78fa91a22923435586e0b94d66d1272d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:45.289266 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1097/2183] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:44 2022] DELETE /identity/v3/users/78fa91a22923435586e0b94d66d1272d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:45.304869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:45.305185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:45.305463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:45.344397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:45.346152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:45.477680 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1087/2184] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:45.503402 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:45.506257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:45.625506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fbc9-5989-4c34-afd5-0336f81e793a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:45.630810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:45.631444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:45.631721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:45.632166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:45.647117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:45.648637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:45.673332 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1098/2185] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:46.120982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:46.122810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:46.152390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a26a2-e954-44bc-8188-e3ebc8a583eb None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:46.167343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:46.168054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:46.168334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:46.168608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] PATH_INFO: `/v3/projects/45c7b982bbff42e0a34031bb72f63fab` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:46.173389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c7b982bbff42e0a34031bb72f63fab)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:46.181375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:46.303814 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c7b982bbff42e0a34031bb72f63fab', 'request_id': 'req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.315649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c7b982bbff42e0a34031bb72f63fab', 'request_id': 'req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.335818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c7b982bbff42e0a34031bb72f63fab', 'request_id': 'req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.353520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] The token cache is being invalidate because project 45c7b982bbff42e0a34031bb72f63fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:46.354911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.355704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.357349 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1088/2186] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:46 2022] DELETE /identity/v3/projects/45c7b982bbff42e0a34031bb72f63fab => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:46.361539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:46.378322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdddf49-27e0-42a7-b2d3-69f26cddbc7b service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:46.484228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:46.484996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:46.485255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:46.485636 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] PATH_INFO: `/v3/users/bc2bec4f96194919900e5f03614be662` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:46.493116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2bec4f96194919900e5f03614be662)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:46.495188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:46.606408 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2bec4f96194919900e5f03614be662'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.607410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2bec4f96194919900e5f03614be662'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.630436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2bec4f96194919900e5f03614be662'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.642313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2bec4f96194919900e5f03614be662'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.656947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:46.658985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2bec4f96194919900e5f03614be662'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:46.670102 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1099/2187] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:46 2022] DELETE /identity/v3/users/bc2bec4f96194919900e5f03614be662 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:46.807840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:46.809395 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:46.824704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d61-82ef-4ee4-adfd-1d6fc1ef1a5c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:46.932898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:46.933978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:46.934504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:46.934807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] PATH_INFO: `/v3/users/8992921b446148769feb5779de372326` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:46.937611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8992921b446148769feb5779de372326)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:46.940870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:46.977169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:47.029363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8992921b446148769feb5779de372326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.044439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8992921b446148769feb5779de372326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.069893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8992921b446148769feb5779de372326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.071131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8992921b446148769feb5779de372326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.077857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bda324e7-2ef4-4dce-ba52-1cfcbfcad9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8992921b446148769feb5779de372326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.085943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.087665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.097249 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1089/2188] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:46 2022] DELETE /identity/v3/users/8992921b446148769feb5779de372326 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:47.101994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.102370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.102817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.124447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:47.125215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd344f6-36c1-47e4-8613-bbf2893c345a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.126308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.193224 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1090/2189] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:47.204848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.206491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.230906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.231905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.232194 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.233880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] PATH_INFO: `/v3/projects/e5a310612b104b7d880332e979e870a0` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.234872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a310612b104b7d880332e979e870a0)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.238320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.313210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97302ecc-03e1-4e81-87e4-f1bf9eb430f8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.324695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a310612b104b7d880332e979e870a0', 'request_id': 'req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.340393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a310612b104b7d880332e979e870a0', 'request_id': 'req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.357051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a310612b104b7d880332e979e870a0', 'request_id': 'req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.379456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] The token cache is being invalidate because project e5a310612b104b7d880332e979e870a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:47.383044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.385149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6d0d6f96-4366-4e3b-826e-a3aa54ee77b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:47.389361 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1100/2190] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:47 2022] DELETE /identity/v3/projects/e5a310612b104b7d880332e979e870a0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:47.391080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.391717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.392019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.392369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.395097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.397276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72c14-3353-43e5-85f2-f2c32c67cd40 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.397668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72c14-3353-43e5-85f2-f2c32c67cd40 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.398128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72c14-3353-43e5-85f2-f2c32c67cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.408285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:47.428526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6be72c14-3353-43e5-85f2-f2c32c67cd40 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:47.430103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6be72c14-3353-43e5-85f2-f2c32c67cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.498217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.498609 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1101/2191] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:47.499963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.506667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.507008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.507879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.524014 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1091/2192] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:47.536769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:47.538545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:47.563006 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1102/2193] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:47.566738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.582436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d6273-21ec-44ea-a82c-e662531478eb service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.596490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.597434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.598943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.599468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.601525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:47.602541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.605197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.639702 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1092/2194] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:10:47.642922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.655904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd116-82ae-4595-b6d6-f638054331f0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.665740 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.666601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.667012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.667422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.668437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.671106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.701834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:47.713500 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1103/2195] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:47 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:10:47.718128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.733683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dffa-7f0a-4ec9-8356-c80f234f5874 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.817058 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.818117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.818559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.818970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.819803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.822582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.852908 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1093/2196] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:47 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:47.856991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.870926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8afa7-b970-4e10-863b-c03d815caffb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.890207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.891670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.892071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.892434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.893352 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.898992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.940868 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1104/2197] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:47.942213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:47.959344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afbb0f-d95d-4707-8439-fcc59729ed2f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:47.965868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:47.966761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:47.967239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:47.972140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:47.973329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:47.976072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:47.999224 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1094/2198] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:10:48.004393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.071057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a98bb0-60de-4a1b-8fd1-a117849e4819 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.085553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.086427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.086956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.087230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] PATH_INFO: `/v3/projects/5df3a81fe48644bd93aa24303c8d47f1/users/7b7750aca4074eb9a9367f44c097d99f/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.140070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df3a81fe48644bd93aa24303c8d47f1, user_id=7b7750aca4074eb9a9367f44c097d99f, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.140070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ec70-695f-4f04-9775-aff4dd16efee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.144845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.146651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:48.184751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22f956-0dde-4b35-9377-883deeaffb9b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.198452 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1105/2199] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:48 2022] PUT /identity/v3/projects/5df3a81fe48644bd93aa24303c8d47f1/users/7b7750aca4074eb9a9367f44c097d99f/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:48.205386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.208732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.208732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.252228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] MFA Rules not processed for user `7b7750aca4074eb9a9367f44c097d99f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:48.253872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:48.301232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.302332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.302332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.302545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] PATH_INFO: `/v3/projects/b45fc7606eeb47cca7f9030f53b0d475` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.303959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45fc7606eeb47cca7f9030f53b0d475)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.305910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.320862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.369334 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1106/2200] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:48.374365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.377163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45fc7606eeb47cca7f9030f53b0d475', 'request_id': 'req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:48.386103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45fc7606eeb47cca7f9030f53b0d475', 'request_id': 'req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:48.390535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a42cdf-3c23-4d96-816e-3dfe015e1017 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.398688 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45fc7606eeb47cca7f9030f53b0d475', 'request_id': 'req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:48.419573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] The token cache is being invalidate because project b45fc7606eeb47cca7f9030f53b0d475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:48.420024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:48.420472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6a44b1d7-82b4-4d47-838f-8ab2ae70aba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:48.422256 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1095/2201] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:48 2022] DELETE /identity/v3/projects/b45fc7606eeb47cca7f9030f53b0d475 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:10:48.428752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a90a-914c-4ab6-b3fb-50536b29de99 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.429455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a90a-914c-4ab6-b3fb-50536b29de99 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.429455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a90a-914c-4ab6-b3fb-50536b29de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.467477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.468321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.468637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.468966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.469589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.474890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.480885 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0231a90a-914c-4ab6-b3fb-50536b29de99 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:48.483169 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0231a90a-914c-4ab6-b3fb-50536b29de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:48.508537 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1096/2202] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:48.516874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.517184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.517416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.523450 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1107/2203] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:48.527621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.531173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:48.573830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:48.577266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:48.596391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.646079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5be3-40bf-4e5d-aefc-0a1e8284fb4e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.654465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.655107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.655380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.655642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.656318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.661317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.718322 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1108/2204] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:48.722325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.729216 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1097/2205] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:10:48.733239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.745356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbc728-980a-4c9f-946b-46cb3b6394b3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.747881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82274f3-300d-4e79-a411-a9b7f0252c46 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.754872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.755356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.755671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.755977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.756664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:10:48.756917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.758593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.763041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.763813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.764188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.764554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.765320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.767866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.777340 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1098/2206] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:10:48.779103 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.794216 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1109/2207] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:48.799826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.800019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88c26-9f79-4118-b163-130c5807d1df admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.813164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.813795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.814580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.815473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.816154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.821124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f05fec-a3d9-4419-b952-9f18288dc2f4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:48.822370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.836586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:48.837556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:48.837556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:48.837778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] PATH_INFO: `/v3/projects/bca449503fb940fab3795c149a732489/users/64df707803a84e7ebd025bec17da1711/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:48.870904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca449503fb940fab3795c149a732489, user_id=64df707803a84e7ebd025bec17da1711, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:48.876600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:48.880173 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1099/2208] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:48.884134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:48.907443 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1110/2209] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:48 2022] PUT /identity/v3/projects/bca449503fb940fab3795c149a732489/users/64df707803a84e7ebd025bec17da1711/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:48.912057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.041722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3311-23e9-4970-b51d-c348a37fda92 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.056529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.058689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6df8-2eda-41c1-aecf-9de66604fec2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.059582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.060021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.060288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.061308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.066035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.075543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.076251 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.076524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.076852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.077727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.080393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05b611-81af-45dc-bb97-cb51538212fa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.086895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:49.108021 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1111/2210] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:49.109492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243860cd-c2a4-4ea4-a974-be1b74b7e0b3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.109774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243860cd-c2a4-4ea4-a974-be1b74b7e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.110050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243860cd-c2a4-4ea4-a974-be1b74b7e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.132872 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1100/2211] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:10:48 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:10:49.132872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.179629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554130d6-e92e-4edd-a24f-2469d22d50f6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.196079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.203593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.203593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.203896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] PATH_INFO: `/v3/projects/bca449503fb940fab3795c149a732489/users/64df707803a84e7ebd025bec17da1711/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.211403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca449503fb940fab3795c149a732489, user_id=64df707803a84e7ebd025bec17da1711, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.216275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.219445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-243860cd-c2a4-4ea4-a974-be1b74b7e0b3 None None] MFA Rules not processed for user `f502d27c3e994141bed8fd464f598e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:49.220898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-243860cd-c2a4-4ea4-a974-be1b74b7e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.253157 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1101/2212] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:49 2022] PUT /identity/v3/projects/bca449503fb940fab3795c149a732489/users/64df707803a84e7ebd025bec17da1711/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:49.254084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.375507 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1112/2213] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:49.377091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.377837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.377837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.426450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab987-136a-484c-bc1f-e473cdb1de0d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.431894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.432517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.432793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.433061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.433717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.435535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.447780 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1102/2214] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:49.448954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.453664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:49.454163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.457958 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] MFA Rules not processed for user `64df707803a84e7ebd025bec17da1711`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:49.469423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.548875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352a73d-9f5c-4700-b3a7-386d31c2ae4b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.554594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.555279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.555555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.555847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.557652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.560478 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1113/2215] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:49.561562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.573773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4577f-2469-4992-8152-bd7fa4806d19 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.578778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.583329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.583775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.584141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.585094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.587366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.601677 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1114/2216] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:10:49.601677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.601677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.640905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.642504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.652679 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1103/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:49.653574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:49.662376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2c6a-7fc6-4d49-a51c-1258e4493a96 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.665712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286e71-c4e9-4a39-a502-3ebe53f43d7b service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:49.668744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.669406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.669628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.669892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.672334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:49.673763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.674579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.675149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] PATH_INFO: `/v3/projects/626cbddb978241a594c3b3fb3c6cae85/users/19591a8b96994e97a5ca295cee0dd0de/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.680364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.682230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:49.683451 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303e27-6886-47bf-9d27-7882796fc0a9 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.700666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=626cbddb978241a594c3b3fb3c6cae85, user_id=19591a8b96994e97a5ca295cee0dd0de, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:49.705500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:49.716166 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1115/2218] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:49.740929 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1104/2219] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:10:49 2022] PUT /identity/v3/projects/626cbddb978241a594c3b3fb3c6cae85/users/19591a8b96994e97a5ca295cee0dd0de/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:49.752813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:49.753378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:49.754174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:49.815406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] MFA Rules not processed for user `19591a8b96994e97a5ca295cee0dd0de`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:49.817030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:49.931488 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1116/2220] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:49.947230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:50.055035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cb04c-1388-4c79-b13e-02c86d9ce48c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:50.059216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:50.059970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:50.060575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:50.061039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:50.076127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:50.077720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a924b8-14db-4240-9bbe-db86d27ebcc2 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:50.093372 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1105/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:50.324987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:50.358843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:50.438866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d88-69c6-4884-a709-4728260a5c3b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:50.439389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d88-69c6-4884-a709-4728260a5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:50.439389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d88-69c6-4884-a709-4728260a5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:50.485801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-16994d88-69c6-4884-a709-4728260a5c3b None None] MFA Rules not processed for user `f5e3e658bdaf4c33baab2d8519d53a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:50.486590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a38c-3469-4973-a800-109d8fbc67f3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:50.487056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-16994d88-69c6-4884-a709-4728260a5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:50.496826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:50.497879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:50.498249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:50.498687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] PATH_INFO: `/v3/users/7b7750aca4074eb9a9367f44c097d99f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:50.501376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7750aca4074eb9a9367f44c097d99f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:50.507800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:50.598315 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7750aca4074eb9a9367f44c097d99f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:50.599055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7750aca4074eb9a9367f44c097d99f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:50.604074 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1106/2222] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:50.610038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7750aca4074eb9a9367f44c097d99f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:50.627598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7750aca4074eb9a9367f44c097d99f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:50.656121 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7750aca4074eb9a9367f44c097d99f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:50.673037 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1117/2223] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:50 2022] DELETE /identity/v3/users/7b7750aca4074eb9a9367f44c097d99f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:50.678663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bbff4-e204-49fa-a49f-00cb59ae6156 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:50.678935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bbff4-e204-49fa-a49f-00cb59ae6156 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:50.679186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bbff4-e204-49fa-a49f-00cb59ae6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:50.722235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-564bbff4-e204-49fa-a49f-00cb59ae6156 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:50.724685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-564bbff4-e204-49fa-a49f-00cb59ae6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:50.815169 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1107/2224] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:50.832474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:50.834115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:50.899053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd91-9970-4934-a4e1-a6f4a9a6b727 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:50.903151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:50.903823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:50.904060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:50.904327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:50.914965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:50.916465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:50.927434 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1118/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:10:51.245520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.245520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.245738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.274430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] MFA Rules not processed for user `2eae4549c0684372af1e4fa3d68fe529`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:51.275658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:51.318911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:51.352592 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1108/2226] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:51.408624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:51.410807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:51.439050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fe612-6e78-4fa0-9c46-01512fa8f597 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:51.450620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:51.451874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.452600 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.453045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] PATH_INFO: `/v3/projects/5df3a81fe48644bd93aa24303c8d47f1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.454697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df3a81fe48644bd93aa24303c8d47f1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:51.457953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:51.518092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:51.534210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df3a81fe48644bd93aa24303c8d47f1', 'request_id': 'req-50b262dc-a739-4164-af9d-2917c3ae3c86'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.545860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df3a81fe48644bd93aa24303c8d47f1', 'request_id': 'req-50b262dc-a739-4164-af9d-2917c3ae3c86'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.561568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df3a81fe48644bd93aa24303c8d47f1', 'request_id': 'req-50b262dc-a739-4164-af9d-2917c3ae3c86'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.577508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] The token cache is being invalidate because project 5df3a81fe48644bd93aa24303c8d47f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:51.577866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.578866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.582207 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1119/2227] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:51 2022] DELETE /identity/v3/projects/5df3a81fe48644bd93aa24303c8d47f1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:51.586242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:51.599572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166567-84a7-43eb-b2e8-bfabc2a58731 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:51.680525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:51.681302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:51.681628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:51.681899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] PATH_INFO: `/v3/users/64df707803a84e7ebd025bec17da1711` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:51.684460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64df707803a84e7ebd025bec17da1711)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:51.687386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:51.771421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64df707803a84e7ebd025bec17da1711'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.802104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64df707803a84e7ebd025bec17da1711'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.818061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64df707803a84e7ebd025bec17da1711'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.818809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64df707803a84e7ebd025bec17da1711'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.819505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3b9e4ebb-ce35-4cc0-94b5-8eeed73d17b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64df707803a84e7ebd025bec17da1711'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:51.846455 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1109/2228] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:10:51 2022] DELETE /identity/v3/users/64df707803a84e7ebd025bec17da1711 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:52.492659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:52.494563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:52.520299 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b262dc-a739-4164-af9d-2917c3ae3c86 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:52.635184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:52.636174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:52.636520 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:52.636855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] PATH_INFO: `/v3/projects/bca449503fb940fab3795c149a732489` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:52.638754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca449503fb940fab3795c149a732489)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:52.640816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:52.729506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca449503fb940fab3795c149a732489', 'request_id': 'req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:52.743525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca449503fb940fab3795c149a732489', 'request_id': 'req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:52.754723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca449503fb940fab3795c149a732489', 'request_id': 'req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:52.774782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] The token cache is being invalidate because project bca449503fb940fab3795c149a732489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:10:52.775082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:52.775868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f5dd6fbd-62be-4bed-9d3c-04c204a0ad4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:10:52.781080 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1120/2229] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:10:52 2022] DELETE /identity/v3/projects/bca449503fb940fab3795c149a732489 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:10:57.934253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:57.934849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:57.934849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:57.956829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] MFA Rules not processed for user `e848774140534fb3bf35d9197ed444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:57.958098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:58.015760 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1110/2230] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:02.766369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:08.008554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:14.055522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7a60-7906-4672-b769-1b02961e4b49 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:14.056058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7a60-7906-4672-b769-1b02961e4b49 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:14.056058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7a60-7906-4672-b769-1b02961e4b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:14.076324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-36df7a60-7906-4672-b769-1b02961e4b49 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:14.077557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-36df7a60-7906-4672-b769-1b02961e4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:14.138407 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1121/2231] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:14.150687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:14.156734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:14.256185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa04c-e6a8-49f9-a119-765f4cf8cf28 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:14.262219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:14.263036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:14.263310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:14.263672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:14.273788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:14.275588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada40a6e-876a-4dc1-bfdd-03d30c84231c service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:14.285255 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1111/2232] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:22.010154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:22.015844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:22.016432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:22.080899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] MFA Rules not processed for user `c635c37222bc444a8e542379af7817fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:22.082481 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:22.331600 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1122/2233] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:24.282001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=32 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:26.781522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.782239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.782239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.812122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:26.820007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:26.852291 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1112/2234] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:26.885759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:26.918901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e473e-3bbd-449d-b9ba-ea3d906758d1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:26.949945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:26.951400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:26.951964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:26.952450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:26.972341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:26.974348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438642d-6e23-4f6c-b1e2-a96a3bad1cbf service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:26.993049 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1123/2235] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:33.151162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:33.153066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.359214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e27a-7977-4848-ab77-f443cf118a29 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:33.373312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:33.374387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.375064 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.375497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] PATH_INFO: `/v3/users/19591a8b96994e97a5ca295cee0dd0de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.376980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19591a8b96994e97a5ca295cee0dd0de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:33.382458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:33.545168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19591a8b96994e97a5ca295cee0dd0de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.613219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19591a8b96994e97a5ca295cee0dd0de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.644455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19591a8b96994e97a5ca295cee0dd0de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.645625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19591a8b96994e97a5ca295cee0dd0de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.647039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19591a8b96994e97a5ca295cee0dd0de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:33.682906 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1113/2236] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:33 2022] DELETE /identity/v3/users/19591a8b96994e97a5ca295cee0dd0de => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:33.690043 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:33.690721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:33.691486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:33.724569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:33.726874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:33.891465 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1124/2237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:33.920968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:33.923853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:34.157698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d55d5-3f70-4ece-9193-770b695cfa41 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:34.178049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:34.180636 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:34.180922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:34.184481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:34.212293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:34.213775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8115c-5f46-49e7-ae6b-731233829017 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:34.247714 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1114/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:35.358383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:35.359930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:35.381227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e29ff-e55b-4bef-88f8-c79d3eecb977 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:35.394763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:35.395668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.400272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.400777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] PATH_INFO: `/v3/projects/626cbddb978241a594c3b3fb3c6cae85` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:35.402313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626cbddb978241a594c3b3fb3c6cae85)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:35.410290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:35.549541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:35.586940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626cbddb978241a594c3b3fb3c6cae85', 'request_id': 'req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.593118 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626cbddb978241a594c3b3fb3c6cae85', 'request_id': 'req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.610247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626cbddb978241a594c3b3fb3c6cae85', 'request_id': 'req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.647094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] The token cache is being invalidate because project 626cbddb978241a594c3b3fb3c6cae85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:35.647528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.648260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c96e5d8-947b-4e5f-8fcc-df8d00652a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:35.653456 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1125/2239] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:35 2022] DELETE /identity/v3/projects/626cbddb978241a594c3b3fb3c6cae85 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:35.660753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.662580 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.663146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:35.708448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:35.711307 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:35.750704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:35.952520 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1115/2240] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:35.960418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:35.961127 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:35.961779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.005370 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:36.006354 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.028059 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1126/2241] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:11:36.047989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.062159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9fdd0-ca63-44da-86f2-0cce5b0fe4e5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.080547 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.085810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.086749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.088344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.090324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:36.092073 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.095766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.144519 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1116/2242] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:11:36.149258 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.171957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db2f9-49d0-47c6-ba63-376444b19593 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.186249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.188259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.188713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.189138 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.189969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.192287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.272538 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1127/2243] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:36.283678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.307444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.310482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.319385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530bf4-2cb9-4caf-a331-454a12686947 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.401230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29eab-c18a-457b-a912-f7958fc25bd8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.416487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.418003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.418577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.419757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.423421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:36.481607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.482628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.482997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.483379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.484909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.490341 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.530741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.533169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.561721 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1128/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:36.562465 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1117/2245] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:36 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:36.566950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.590929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced824-3919-4d6e-988e-15acf8baacee admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.605721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.606478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.606845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.607267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.608181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.610657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.636027 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1118/2246] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:36.647045 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.668851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab41d2-7887-48ba-9980-850da2cbccd4 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.684809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.685967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.686332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.686506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.687246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.690191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1e9f-0895-4f25-846c-a45030b8735c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:36.706393 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1129/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:36.710565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:36.736482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd611-147f-4e59-9628-47af2611df38 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:36.752250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:36.752950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:36.753236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:36.761039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] PATH_INFO: `/v3/projects/98623edd086947859ca68c4c9244738d/users/b7a9ea4bb6b749e3a9561f2c241e87a8/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:36.837958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98623edd086947859ca68c4c9244738d, user_id=b7a9ea4bb6b749e3a9561f2c241e87a8, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:36.837958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.037903 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1119/2248] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:36 2022] PUT /identity/v3/projects/98623edd086947859ca68c4c9244738d/users/b7a9ea4bb6b749e3a9561f2c241e87a8/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:37.050908 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad40c-e0f0-4863-9be0-5be907a4efc3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.051276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad40c-e0f0-4863-9be0-5be907a4efc3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.051470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad40c-e0f0-4863-9be0-5be907a4efc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.186892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d68ad40c-e0f0-4863-9be0-5be907a4efc3 None None] MFA Rules not processed for user `b7a9ea4bb6b749e3a9561f2c241e87a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:37.188554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d68ad40c-e0f0-4863-9be0-5be907a4efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.239265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:37.405909 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1130/2249] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:37.419061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:37.421164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:37.567020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f047de-ad7c-4c83-ae1d-6a3b36f4c304 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:37.578230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:37.580970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:37.581359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:37.581733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:37.593766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:37.597337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:37.604068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:37.632402 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1120/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:41.659910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:41.660856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:41.661381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:41.685276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:41.686970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:41.836317 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1131/2251] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:41.854853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:41.856570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:42.058225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0f9c-0cbc-483b-84cf-681e77a742dd service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:42.067003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:42.068959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:42.069697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:42.070584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:42.082812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:42.084687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:42.101735 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1121/2252] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:44.616548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:44.618565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:44.732829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c3cd-3855-4aa5-9dab-0b3dffe4131c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:44.737749 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:44.738469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:44.738754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:44.739029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] PATH_INFO: `/v3/users/f5e3e658bdaf4c33baab2d8519d53a76` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:44.740799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e3e658bdaf4c33baab2d8519d53a76)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:44.742785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:44.818859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e3e658bdaf4c33baab2d8519d53a76'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:44.819620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e3e658bdaf4c33baab2d8519d53a76'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:44.832122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e3e658bdaf4c33baab2d8519d53a76'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:44.845697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e3e658bdaf4c33baab2d8519d53a76'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:44.851925 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:44.863721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12a2ff84-7978-4549-8525-5814adacc5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e3e658bdaf4c33baab2d8519d53a76'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:44.876652 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1132/2253] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:44 2022] DELETE /identity/v3/users/f5e3e658bdaf4c33baab2d8519d53a76 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:45.101406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.115980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff951b-2265-49d7-ae56-ceae4cff3021 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.223083 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.224257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.224816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.225264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] PATH_INFO: `/v3/projects/bab98f4842584867864f1e6af67a1f70` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.227281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab98f4842584867864f1e6af67a1f70)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.241114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.326736 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab98f4842584867864f1e6af67a1f70', 'request_id': 'req-c4342356-e52a-4ca9-9281-4e153c372342'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.335824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab98f4842584867864f1e6af67a1f70', 'request_id': 'req-c4342356-e52a-4ca9-9281-4e153c372342'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.349986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab98f4842584867864f1e6af67a1f70', 'request_id': 'req-c4342356-e52a-4ca9-9281-4e153c372342'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.367345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] The token cache is being invalidate because project bab98f4842584867864f1e6af67a1f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:45.368031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.368969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c4342356-e52a-4ca9-9281-4e153c372342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:45.371104 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1122/2254] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:45 2022] DELETE /identity/v3/projects/bab98f4842584867864f1e6af67a1f70 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:45.378930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.380340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.380809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.413762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:45.415005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.486019 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1133/2255] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:45.494767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.495049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.495320 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.516480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:45.517752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.525790 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1123/2256] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:45.530364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.541637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de542ce-c3ca-4035-9ce2-7864dc1b3f29 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.546780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.547474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.547775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.548050 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.548709 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:11:45.549012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.550876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.563697 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1134/2257] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:11:45.569096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.578735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f0f3-cc05-4577-9a27-aba8fe5ada6d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.591219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.591219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.591219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.591219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.591605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.591605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.601708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:45.625030 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1124/2258] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:11:45.626154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.637269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d751-e53b-4e2c-af1d-3f75ea4d6674 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.699895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.700519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.700819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.701082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.701724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.703699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.729213 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1135/2259] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:11:45.733700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.746092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2e19-343d-4875-88f3-77577457f0e3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.752141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.752811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.753082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.753334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.753993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.755997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.767605 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1125/2260] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:11:45.772075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.783144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80836f8-97e7-497e-b5cf-0eb6180d8fda admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.788985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.789780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.790058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.790329 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.790996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.792754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768714f4-db7a-486d-80b0-d4e8280894a4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.804627 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1136/2261] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:11:45.809107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.819618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04bf2-d14d-42b4-bec5-41b2f855e5d3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:45.824875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:45.825539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.825822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.826130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] PATH_INFO: `/v3/projects/582df464c41d42c2ad433276fce39088/users/7fd6e0a5762741e1a3392160389a6ee6/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.841644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=582df464c41d42c2ad433276fce39088, user_id=7fd6e0a5762741e1a3392160389a6ee6, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:45.844445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:45.859269 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1126/2262] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:11:45 2022] PUT /identity/v3/projects/582df464c41d42c2ad433276fce39088/users/7fd6e0a5762741e1a3392160389a6ee6/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:45.869549 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59404-d977-4bc6-83ef-d21c2405642a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:45.869855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59404-d977-4bc6-83ef-d21c2405642a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:45.870110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59404-d977-4bc6-83ef-d21c2405642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:45.898071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-93c59404-d977-4bc6-83ef-d21c2405642a None None] MFA Rules not processed for user `7fd6e0a5762741e1a3392160389a6ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:45.899301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-93c59404-d977-4bc6-83ef-d21c2405642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:45.940833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:45.967469 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1137/2263] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:45.980196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:45.982068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:46.044531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0d4-d9bb-4e3f-bdff-3459f38a9fae admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:46.048848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:46.049498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:46.049776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:46.050048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:46.059047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:46.060514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280848a7-b58d-4cfc-9011-4e41ec16684d service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:46.069575 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1127/2264] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:48.406220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.406775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.406775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.408173 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1138/2265] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:48.414344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aed23-f2cb-4986-8c75-368edb94a477 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.414897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aed23-f2cb-4986-8c75-368edb94a477 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.415161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aed23-f2cb-4986-8c75-368edb94a477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.435861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a93aed23-f2cb-4986-8c75-368edb94a477 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:48.437162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a93aed23-f2cb-4986-8c75-368edb94a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.510907 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1128/2266] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:48.523035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.525053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.586547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d2a4-38dc-420b-84dc-98b99bff6825 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.590387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.591023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.591421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.591699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.602359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.603987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c1db4-d6f0-4a30-b857-a13c36c53d82 service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.614872 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1139/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:48.691018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.691301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.691585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.692997 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1129/2268] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:48.698217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee7f-9980-49e3-8104-4758906ccb6e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.698501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee7f-9980-49e3-8104-4758906ccb6e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.698837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee7f-9980-49e3-8104-4758906ccb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.719583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c759ee7f-9980-49e3-8104-4758906ccb6e None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:48.720817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c759ee7f-9980-49e3-8104-4758906ccb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.777345 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1140/2269] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:48.790366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.792319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.809117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a2b7-e530-4c7b-a9df-22658a325996 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:48.814127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:48.817914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.817914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.817914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.827124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:48.829374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c556d1-7146-4960-a432-fff68f15299c service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:48.839289 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1130/2270] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:48.929289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021153-6421-4da6-b859-c51092ff51ec None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.929574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021153-6421-4da6-b859-c51092ff51ec None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.929847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021153-6421-4da6-b859-c51092ff51ec None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.931472 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1141/2271] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:11:48.937105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:48.937624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:48.937967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:48.964466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:48.965944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:48.975696 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1131/2272] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:48.987500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021153-6421-4da6-b859-c51092ff51ec None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:48.999149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021153-6421-4da6-b859-c51092ff51ec None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.003493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.004179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.004493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.004760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.015357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:49.016910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbc4d4-53bb-433d-a4c1-55fd1149487e service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.028102 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1142/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:49.381782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:49.383361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:49.425095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:49.470250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4cec-5437-4ffc-8f58-d3dca63f2a29 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.476457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.477496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.477906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.478208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] PATH_INFO: `/v3/users/b7a9ea4bb6b749e3a9561f2c241e87a8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.479386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a9ea4bb6b749e3a9561f2c241e87a8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:49.481401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.530504 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a9ea4bb6b749e3a9561f2c241e87a8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.542720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a9ea4bb6b749e3a9561f2c241e87a8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.551202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a9ea4bb6b749e3a9561f2c241e87a8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.551836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a9ea4bb6b749e3a9561f2c241e87a8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.552421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a9ea4bb6b749e3a9561f2c241e87a8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:49.566473 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1132/2274] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:49 2022] DELETE /identity/v3/users/b7a9ea4bb6b749e3a9561f2c241e87a8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:49.572410 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.573971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.574724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.596820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:49.598066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:49.664941 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1143/2275] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:49.675607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:49.677249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:49.744237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f36db-117d-409c-9291-6e050b1a1811 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:49.748039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:49.748649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:49.748922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:49.749190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:49.759517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:49.761113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:49.770823 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1133/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:50.068145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:50.069618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:50.084814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d688-e31c-41a1-965c-4e4236bd2b6e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:50.104593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:50.105027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:50.105298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:50.105643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] PATH_INFO: `/v3/projects/98623edd086947859ca68c4c9244738d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:50.107010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98623edd086947859ca68c4c9244738d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:50.109423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:50.131975 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:50.166128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98623edd086947859ca68c4c9244738d', 'request_id': 'req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:50.171625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98623edd086947859ca68c4c9244738d', 'request_id': 'req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:50.180890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98623edd086947859ca68c4c9244738d', 'request_id': 'req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:50.192606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] The token cache is being invalidate because project 98623edd086947859ca68c4c9244738d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:50.192895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:50.193526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0357c8fd-cbb4-4c80-972b-2c71cb11e7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:50.195029 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1144/2277] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:50 2022] DELETE /identity/v3/projects/98623edd086947859ca68c4c9244738d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:51.169829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.171368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.184708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d2d3-e6d8-445a-84f9-fcd956cc9037 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.233542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:51.243875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.244564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.244972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.245544 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] PATH_INFO: `/v3/users/7fd6e0a5762741e1a3392160389a6ee6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.246720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd6e0a5762741e1a3392160389a6ee6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.248684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.302715 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd6e0a5762741e1a3392160389a6ee6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.315877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd6e0a5762741e1a3392160389a6ee6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.325123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd6e0a5762741e1a3392160389a6ee6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.325876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd6e0a5762741e1a3392160389a6ee6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.326578 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd6e0a5762741e1a3392160389a6ee6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.338942 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1134/2278] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:11:51 2022] DELETE /identity/v3/users/7fd6e0a5762741e1a3392160389a6ee6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:11:51.343629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171c55d-ee2f-4ab8-8ed2-d54968f65f20 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.344176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171c55d-ee2f-4ab8-8ed2-d54968f65f20 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.344263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171c55d-ee2f-4ab8-8ed2-d54968f65f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.364255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4171c55d-ee2f-4ab8-8ed2-d54968f65f20 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:51.365461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4171c55d-ee2f-4ab8-8ed2-d54968f65f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.432376 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1145/2279] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:51.442364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.443856 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.514292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a0bb5-6ff0-4bc8-b6a7-3ba0e9963eb8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.519297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.519945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.520221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.520486 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.531180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.532778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.543245 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1135/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:51.590278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.590543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.590812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.612688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:11:51.613923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.678635 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1146/2281] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:11:51.691512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.693036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.767172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f11-8340-48a2-afca-056b76a7edbc service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.772261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.772875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.773152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.773421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.782017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.783707 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf2adc-799e-48e0-9229-4aa53d7d0d40 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.792567 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1136/2282] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:51.831671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:51.833723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:11:51.850487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b310-d2a4-4732-91da-8942338790cc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:51.856719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:51.857382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:51.857653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:51.857967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] PATH_INFO: `/v3/projects/582df464c41d42c2ad433276fce39088` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:51.859200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582df464c41d42c2ad433276fce39088)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:51.861200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:51.938809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:51.949193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582df464c41d42c2ad433276fce39088', 'request_id': 'req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.960375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582df464c41d42c2ad433276fce39088', 'request_id': 'req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:51.976382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582df464c41d42c2ad433276fce39088', 'request_id': 'req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:52.007369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] The token cache is being invalidate because project 582df464c41d42c2ad433276fce39088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:11:52.007967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:52.009999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:11:52.015324 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1147/2283] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:11:51 2022] DELETE /identity/v3/projects/582df464c41d42c2ad433276fce39088 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:12:01.789034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:01.998035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:13.308768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:13.309337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:13.309337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:13.328526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:13.329703 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:13.395872 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1137/2284] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:13.408638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:13.410666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:13.485960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef2c1-3b4c-4816-9832-e5a28d3ba7e7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:13.491513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:13.492153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:13.492429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:13.492697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:13.501316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:13.503005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea904f1-c401-4521-ba31-42a499ba9f88 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:13.513096 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1148/2285] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:18.114986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:18.116507 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:18.195798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37d39e-391b-414e-80f3-661cb92524b2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:18.200916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:18.201528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:18.201826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:18.202090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:18.204117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:18.217534 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:18.219141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eff41-af51-4b60-8813-69f62b6d7360 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:18.233485 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1138/2286] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:23.509284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=32 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:28.226062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=57 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:28.945922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790821e0-3055-4a16-bdbb-02a50f9ebdb8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:28.946474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790821e0-3055-4a16-bdbb-02a50f9ebdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:28.946474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790821e0-3055-4a16-bdbb-02a50f9ebdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:28.967193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-790821e0-3055-4a16-bdbb-02a50f9ebdb8 None None] MFA Rules not processed for user `e848774140534fb3bf35d9197ed444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:28.968580 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-790821e0-3055-4a16-bdbb-02a50f9ebdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:29.028627 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1149/2287] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:39.021486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=25 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:55.353465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0cf4-901d-4392-9aaf-4e828489af6f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:55.354011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0cf4-901d-4392-9aaf-4e828489af6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:55.354011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0cf4-901d-4392-9aaf-4e828489af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:55.374990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-74ee0cf4-901d-4392-9aaf-4e828489af6f None None] MFA Rules not processed for user `c635c37222bc444a8e542379af7817fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:55.376212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-74ee0cf4-901d-4392-9aaf-4e828489af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:55.442005 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1139/2288] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:13:03.288029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e15c-b597-4c23-8529-fbdf6620b000 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:03.288567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e15c-b597-4c23-8529-fbdf6620b000 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:03.288567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e15c-b597-4c23-8529-fbdf6620b000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:03.309078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0461e15c-b597-4c23-8529-fbdf6620b000 None None] MFA Rules not processed for user `46af30b9e2ab484f81b83e21555e8aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:03.310276 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0461e15c-b597-4c23-8529-fbdf6620b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:03.368592 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1150/2289] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:05.433766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=25 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:13.360831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=25 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:31.792346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:31.792346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:31.792346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:31.812772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] MFA Rules not processed for user `bfe5047fd5fc46f9bd9ed3c037c554ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:31.814202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:31.870401 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1140/2290] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:13:33.759561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:13:33.760125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:13:33.760305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:13:33.781003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] MFA Rules not processed for user `e848774140534fb3bf35d9197ed444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:13:33.782461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:13:33.790389 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1151/2291] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:13:41.863372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=25 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:43.775115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:00.050772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:00.052442 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:00.113066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab0c42-7daa-467b-89dd-3f8dd69f1ab5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:00.117032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:00.117527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:00.117812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:00.118139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:00.119963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:00.197562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:00.199279 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:00.210694 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1141/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:02.434909 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.445440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c2098-8c60-480d-b4be-5efd1d45c7bf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.450236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.450838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.451111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.451369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.453463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:02.519294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.520855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcbb53-f51c-4a72-b77d-4260a7024c68 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.530387 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1152/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:02.844457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:02.846084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:02.857666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0433a1-9fcd-42de-bbc3-0f8a8d1c5051 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:02.861892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:02.862705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:02.863186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:02.863546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:02.865520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:02.881565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:02.883009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487486c-6736-4907-90b1-cf3c6ab1fda3 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:02.894019 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1142/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:03.294756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9373-aee1-4365-bd31-f24a27b51ec8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.295037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9373-aee1-4365-bd31-f24a27b51ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.295360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9373-aee1-4365-bd31-f24a27b51ec8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.297436 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1153/2295] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:14:03.307079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ad62-23d6-4bfd-bb72-dc9d76509850 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.307639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ad62-23d6-4bfd-bb72-dc9d76509850 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.308005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ad62-23d6-4bfd-bb72-dc9d76509850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.331061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-06f3ad62-23d6-4bfd-bb72-dc9d76509850 None None] MFA Rules not processed for user `244d9918798e46afac5635b7374e0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:03.332322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-06f3ad62-23d6-4bfd-bb72-dc9d76509850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:03.340158 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1143/2296] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:03.352521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9373-aee1-4365-bd31-f24a27b51ec8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:03.365644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9373-aee1-4365-bd31-f24a27b51ec8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:03.369562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:03.377951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.378488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.378973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.388219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:03.389875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a0c02-3ecf-41bd-9091-789597f8bbb3 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:03.398589 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1154/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:03.492969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f01c-7fb2-4cb4-aac7-fcb05ce0baf9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.493330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f01c-7fb2-4cb4-aac7-fcb05ce0baf9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.493670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f01c-7fb2-4cb4-aac7-fcb05ce0baf9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.495213 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1144/2298] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:14:03.501477 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217d71-8fb1-4806-b029-a45a2a77037f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.501992 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217d71-8fb1-4806-b029-a45a2a77037f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.502516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217d71-8fb1-4806-b029-a45a2a77037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.529610 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-76217d71-8fb1-4806-b029-a45a2a77037f None None] MFA Rules not processed for user `cafb054c1ff2433ca610bd9b50466720`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:03.531280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76217d71-8fb1-4806-b029-a45a2a77037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:03.543258 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1155/2299] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:03.554413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f01c-7fb2-4cb4-aac7-fcb05ce0baf9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:03.578699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f01c-7fb2-4cb4-aac7-fcb05ce0baf9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:03.583967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:03.584627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:03.584904 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:03.585301 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:03.597564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:03.599635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96872200-0797-4b59-baef-0a5baf53bdcd service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:03.612524 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1145/2300] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:06.634818 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:06.635457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:06.635576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.636950 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1156/2301] 10.222.0.23 () {54 vars in 921 bytes} [Sun Aug 21 01:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:14:06.647863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:06.648387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:06.648493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.668875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] MFA Rules not processed for user `167a92c0eb6d4e609b369e8c359b94cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:06.670074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:06.678733 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1146/2302] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Aug 21 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:06.692669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:06.694498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:06.708589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:06.710322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:06.713414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318e2bf-dfca-4917-b3c3-75f8d4fac71a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:06.718290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:06.718897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:06.719171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:06.719440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.728849 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:06.730091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c655562-8ff7-45ab-a4be-79091e9c2281 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:06.731114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:06.735405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:06.736182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:06.736440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:06.736731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] PATH_INFO: `/v3/users/c635c37222bc444a8e542379af7817fa` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:06.737839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c635c37222bc444a8e542379af7817fa)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:06.739831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:06.742300 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1157/2303] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:06.792651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c635c37222bc444a8e542379af7817fa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:06.799420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:06.805193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c635c37222bc444a8e542379af7817fa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:06.814620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c635c37222bc444a8e542379af7817fa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:06.815267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c635c37222bc444a8e542379af7817fa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:06.815922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7abdf314-8b49-42f3-8fba-c6d77a1290eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c635c37222bc444a8e542379af7817fa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:06.828052 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1147/2304] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:06 2022] DELETE /identity/v3/users/c635c37222bc444a8e542379af7817fa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:07.042388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.055163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4abc2-afad-488e-b900-354820515a2a service placement] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.130686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.131330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.131607 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.131912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] PATH_INFO: `/v3/projects/7ac7a5ef43764cedb58337cbd5376304` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.133036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac7a5ef43764cedb58337cbd5376304)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.135661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.185267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac7a5ef43764cedb58337cbd5376304', 'request_id': 'req-7a2b3702-a909-49ad-b11d-245f8221ac10'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.190832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac7a5ef43764cedb58337cbd5376304', 'request_id': 'req-7a2b3702-a909-49ad-b11d-245f8221ac10'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.194693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:07.201275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac7a5ef43764cedb58337cbd5376304', 'request_id': 'req-7a2b3702-a909-49ad-b11d-245f8221ac10'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.215940 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] The token cache is being invalidate because project 7ac7a5ef43764cedb58337cbd5376304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:07.216228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.220712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a2b3702-a909-49ad-b11d-245f8221ac10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:07.222384 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1158/2305] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:07 2022] DELETE /identity/v3/projects/7ac7a5ef43764cedb58337cbd5376304 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:07.227252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.227623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.227969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.248626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:07.249811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.310414 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1148/2306] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:07.322440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.322745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.323012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.343720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:07.345028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.353539 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1159/2307] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:07.358317 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.369313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424ee0-5add-4207-b5fa-03fcdc090943 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.379813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.381244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.381988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.382691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.384183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:07.384642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.386300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.402113 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1149/2308] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:07.408707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.418713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1699-6147-4dcb-bed3-54285cdd5003 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.425188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.425786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.426057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.426322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.426943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.429371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.461653 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1160/2309] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:07 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:07.466168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.476214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1df92a-1fd1-4d8f-8706-cdb0586b418c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.532217 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.533189 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.533468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.533737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.534378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.536459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.558899 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1150/2310] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:07 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:07.563255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.575295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df7f8-ee30-4b4d-8398-09fc2fa5805a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.581004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.581641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.581912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.582199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.582833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.584500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.594726 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1161/2311] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:14:07.599033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.609353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42c1b-8b8e-44fe-bffa-e598ee071a1b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.614563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.615159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.615433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.615701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.616373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.617961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767510-bb8a-4c73-846d-9c7ae43beeaf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.629502 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1151/2312] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:07.633839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.644423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7e19-135b-4b27-a9eb-103c03ac22c6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.649416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.650134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.650426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.650692 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] PATH_INFO: `/v3/projects/03af64a3d9e44ee68ae271cb5045e57d/users/3fba2237147e4cd8bbb4f2a35659aa72/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.666395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03af64a3d9e44ee68ae271cb5045e57d, user_id=3fba2237147e4cd8bbb4f2a35659aa72, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.669151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.684971 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1162/2313] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:07 2022] PUT /identity/v3/projects/03af64a3d9e44ee68ae271cb5045e57d/users/3fba2237147e4cd8bbb4f2a35659aa72/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:07.695457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.696003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.696124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.725900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] MFA Rules not processed for user `3fba2237147e4cd8bbb4f2a35659aa72`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:07.727117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.761385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:07.805750 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1152/2314] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:07.816931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:07.819104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:07.896623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ccd7-ad0b-47f1-bea1-976f89c1fdc9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:07.903344 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:07.903964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:07.904235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:07.904497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:07.913341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:07.915380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991919b2-4cdf-4c0d-9e11-eea940f5e51a service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:07.924305 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1163/2315] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:10.751312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:10.813540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67b87f-fc14-4fb9-85e7-f3883cd87949 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:10.817954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:10.818595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.818874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.819143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] PATH_INFO: `/v3/users/3fba2237147e4cd8bbb4f2a35659aa72` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.820354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fba2237147e4cd8bbb4f2a35659aa72)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:10.822286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:10.874786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fba2237147e4cd8bbb4f2a35659aa72'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.887536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fba2237147e4cd8bbb4f2a35659aa72'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.896874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fba2237147e4cd8bbb4f2a35659aa72'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.897494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fba2237147e4cd8bbb4f2a35659aa72'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.898096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fba2237147e4cd8bbb4f2a35659aa72'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:10.913609 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1153/2316] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:10 2022] DELETE /identity/v3/users/3fba2237147e4cd8bbb4f2a35659aa72 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:10.918447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:10.918959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:10.918959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:10.938304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:10.939497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.005232 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1164/2317] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:11.014660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.016132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.073515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:11.078567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69799-f9a4-4992-a14a-1790163699f6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.084253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.084956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.085267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.085538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.096216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.097797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd08e8-dfc1-4295-8952-0ce4e3faa3b9 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.108367 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1154/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:11.397200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.398695 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.413714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7dc4-225c-481f-ba73-bf4d572c595f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.419306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.420071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.420414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.420734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] PATH_INFO: `/v3/projects/03af64a3d9e44ee68ae271cb5045e57d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.422664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03af64a3d9e44ee68ae271cb5045e57d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.426232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.435097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:11.478216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03af64a3d9e44ee68ae271cb5045e57d', 'request_id': 'req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.484808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03af64a3d9e44ee68ae271cb5045e57d', 'request_id': 'req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.493875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03af64a3d9e44ee68ae271cb5045e57d', 'request_id': 'req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.505335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] The token cache is being invalidate because project 03af64a3d9e44ee68ae271cb5045e57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:11.505618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.506701 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dee20aa7-bbc3-4de6-aabb-06da10c2ced3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:11.508101 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1165/2319] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:11 2022] DELETE /identity/v3/projects/03af64a3d9e44ee68ae271cb5045e57d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:11.514664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.514943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.515211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.538295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.539595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.601900 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1155/2320] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:11.612729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.613124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.613568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.635144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:11.637091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:11.651018 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1166/2321] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:11.657786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.668905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1997dd2-c6ea-4de9-8035-30a42b2da98b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.674598 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.675198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.675469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.675771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.676419 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:11.676716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.678303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.691106 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1156/2322] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:11.695539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.705494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e2d3-c06e-4d5f-af3d-352bcb83edd7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.711380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.712035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.712289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.712537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.713157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.715560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.749425 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1167/2323] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:11.750612 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.761213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae93874-0828-458d-84fa-9b1c32c800d4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.819426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.820122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.820370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.820746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.821372 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.823911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.847624 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1157/2324] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:11.852056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.862786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df3c8-20c2-4e07-9f6c-9af954459db1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.867767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.868390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.868669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.868937 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.869590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.871484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.884572 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1168/2325] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:11.888854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.898740 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05fc13-8604-4728-997f-4b1e926abde6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.903816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.904416 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.904690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.904960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.905606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.907197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa8b79-f5aa-4c30-911d-bfa7defc3cff admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.918363 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1158/2326] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:11.923209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:11.935055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a826-bc2b-4efa-b341-a54c042d016a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:11.940296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:11.940951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.941226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.941528 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] PATH_INFO: `/v3/projects/92fcc620c22447e48a6d81ee014382bb/users/fa86b200d89c4488a0d083f1cf4e61a4/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:11.957364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fcc620c22447e48a6d81ee014382bb, user_id=fa86b200d89c4488a0d083f1cf4e61a4, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:11.960051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:11.975388 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1169/2327] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:11 2022] PUT /identity/v3/projects/92fcc620c22447e48a6d81ee014382bb/users/fa86b200d89c4488a0d083f1cf4e61a4/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:11.986065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:11.986376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:11.986644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.014632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] MFA Rules not processed for user `fa86b200d89c4488a0d083f1cf4e61a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:12.015883 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:12.061582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:12.082508 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1159/2328] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:12.087371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.152775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9c4f-12ef-4cfb-ae96-4a38eadc037a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.157930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.158530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.158803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.159070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.159697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.161641 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.191602 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1170/2329] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:12 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:12.195753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.206864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb515-73fe-4a55-8f45-4ee1a5c5b7fc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.268078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.268825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.269102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.269365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.270018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.272030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.295186 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1160/2330] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:12 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:12.299296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.310308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f026-05a2-4790-81c8-441a2e3e6312 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.315780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.316380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.316658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.316930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.317598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.319514 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.330629 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1171/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:12.335490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.351533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6de4-bcb6-4de9-81a5-b403bccb466e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.360872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782916-659a-4254-8281-2393787159fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.361976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782916-659a-4254-8281-2393787159fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.362369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782916-659a-4254-8281-2393787159fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.362618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782916-659a-4254-8281-2393787159fe admin admin] PATH_INFO: `/v3/projects/69f835c048e64e4db482f0203712d902/users/f5a8e98f52fd4ed58cd6280fb2589b65/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.385956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33782916-659a-4254-8281-2393787159fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f835c048e64e4db482f0203712d902, user_id=f5a8e98f52fd4ed58cd6280fb2589b65, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.388666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33782916-659a-4254-8281-2393787159fe admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.403821 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1161/2332] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:12 2022] PUT /identity/v3/projects/69f835c048e64e4db482f0203712d902/users/f5a8e98f52fd4ed58cd6280fb2589b65/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:12.409598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.421130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca30-b3c1-4f47-9657-b05d4ba0915d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.425504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:12.483595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.484237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.484511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.484776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.485422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.487038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee070b5-a7ac-439c-a946-9bc1d40df261 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.497310 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1172/2333] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:12.501698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782916-659a-4254-8281-2393787159fe admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.512745 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782916-659a-4254-8281-2393787159fe admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.517683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.518334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.518614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.518884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] PATH_INFO: `/v3/projects/69f835c048e64e4db482f0203712d902/users/f5a8e98f52fd4ed58cd6280fb2589b65/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.520847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f835c048e64e4db482f0203712d902, user_id=f5a8e98f52fd4ed58cd6280fb2589b65, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.523454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.534677 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1162/2334] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:12 2022] PUT /identity/v3/projects/69f835c048e64e4db482f0203712d902/users/f5a8e98f52fd4ed58cd6280fb2589b65/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:12.548093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.548093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.548093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.584530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] MFA Rules not processed for user `f5a8e98f52fd4ed58cd6280fb2589b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:12.585838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:12.662408 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1173/2335] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:12.674157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.676003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:12.739263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31432d0-ce2d-4c73-8c32-d8ce119a1b02 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.744002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.745085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.745407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.745673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.756174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.757600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.768097 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1163/2336] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:12.880274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:12.893403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa28194-8d9b-4260-989e-a094ab3fb9b3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:12.897716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:12.898331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:12.898606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:12.898874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:12.959234 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:12.960654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a5c5-1dc1-4a46-a24a-2a9e7ffff482 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:12.970095 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1174/2337] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:15.674672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:15.721635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:15.744171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91983a-ab88-4a9a-94f8-f9cfd41e9fd7 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:15.749533 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:15.750288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:15.750653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:15.751012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] PATH_INFO: `/v3/users/fa86b200d89c4488a0d083f1cf4e61a4` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:15.752355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa86b200d89c4488a0d083f1cf4e61a4)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:15.754259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:15.805415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa86b200d89c4488a0d083f1cf4e61a4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:15.817859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa86b200d89c4488a0d083f1cf4e61a4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:15.826158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa86b200d89c4488a0d083f1cf4e61a4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:15.826757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa86b200d89c4488a0d083f1cf4e61a4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:15.827379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa86b200d89c4488a0d083f1cf4e61a4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:15.839069 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1164/2338] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:15 2022] DELETE /identity/v3/users/fa86b200d89c4488a0d083f1cf4e61a4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:15.844148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:15.844661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:15.844759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:15.864007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:15.865217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:15.886172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:15.928635 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1175/2339] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:15.943670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:15.945204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:16.016632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69459a-d2aa-4bf6-b34e-6d4a3bac23ea admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:16.020660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:16.021290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:16.021655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:16.021940 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:16.032854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:16.034296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:16.044142 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1165/2340] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:16.344461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:16.345924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:16.359341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39351bfb-335c-4066-a0fe-98425e5a79bc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:16.365103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:16.365545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:16.365824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:16.366089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] PATH_INFO: `/v3/projects/92fcc620c22447e48a6d81ee014382bb` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:16.367237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fcc620c22447e48a6d81ee014382bb)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:16.369341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:16.435453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fcc620c22447e48a6d81ee014382bb', 'request_id': 'req-77699e1b-a8c6-4590-a896-f4d4f8bc133c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.444866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fcc620c22447e48a6d81ee014382bb', 'request_id': 'req-77699e1b-a8c6-4590-a896-f4d4f8bc133c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.456360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fcc620c22447e48a6d81ee014382bb', 'request_id': 'req-77699e1b-a8c6-4590-a896-f4d4f8bc133c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.470834 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] The token cache is being invalidate because project 92fcc620c22447e48a6d81ee014382bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:16.471114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.471764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.473281 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1176/2341] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:16 2022] DELETE /identity/v3/projects/92fcc620c22447e48a6d81ee014382bb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:16.477633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:16.487499 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353efc7-c333-40a1-a631-be46a67025ee service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:16.548541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:16.549175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:16.549456 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:16.549716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] PATH_INFO: `/v3/users/f5a8e98f52fd4ed58cd6280fb2589b65` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:16.550955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a8e98f52fd4ed58cd6280fb2589b65)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:16.552925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:16.557510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:16.604178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a8e98f52fd4ed58cd6280fb2589b65'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.615709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a8e98f52fd4ed58cd6280fb2589b65'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.623355 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a8e98f52fd4ed58cd6280fb2589b65'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.624210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a8e98f52fd4ed58cd6280fb2589b65'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.625174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6b6894e7-e15d-42fd-8077-2b9913abd895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a8e98f52fd4ed58cd6280fb2589b65'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:16.641310 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1166/2342] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:16 2022] DELETE /identity/v3/users/f5a8e98f52fd4ed58cd6280fb2589b65 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:16.945655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:16.947218 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:16.962365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77699e1b-a8c6-4590-a896-f4d4f8bc133c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.028245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.028893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.029200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.029461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] PATH_INFO: `/v3/projects/69f835c048e64e4db482f0203712d902` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.030598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f835c048e64e4db482f0203712d902)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.032933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.095123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f835c048e64e4db482f0203712d902', 'request_id': 'req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:17.097080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:17.102170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f835c048e64e4db482f0203712d902', 'request_id': 'req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:17.111082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f835c048e64e4db482f0203712d902', 'request_id': 'req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:17.123242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] The token cache is being invalidate because project 69f835c048e64e4db482f0203712d902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:17.123437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:17.124133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9059a840-1ae5-41b4-8eb8-dc4ab3bd6724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:17.125730 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1177/2343] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:16 2022] DELETE /identity/v3/projects/69f835c048e64e4db482f0203712d902 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:17.132689 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.133220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.133220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.153051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:17.154447 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:17.216861 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1167/2344] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:17.224660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.224944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.225192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.245461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:17.247040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:17.255539 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1178/2345] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:17.260254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.271630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0053b0-33a0-4f30-bc26-bcde79678fcd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.276980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.277601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.277945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.278280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.278969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:17.279273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.280926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.297372 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1168/2346] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:17.298643 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.308278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f973a-4d12-4b11-9693-012b3681e5df None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.313720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.314326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.314601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.314890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.315512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.317473 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.350872 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1179/2347] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:17.356411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.366138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1c50-5d69-4eef-83d4-041bcc2882d3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.424094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.424695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.424967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.425233 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.425843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.427867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.447633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:17.454944 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1169/2348] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:17.459228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.471038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a85d-6691-42c3-9a1e-478c4b7235c8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.477161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.477768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.478053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.478320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.478968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.480632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.491900 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1180/2349] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:17.496075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.507040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2284-3296-454c-8fa6-1f961ee9a804 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.512759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.513367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.513643 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.513913 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.514567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.516214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663238de-0dd4-4602-b0a1-7ed5765b2692 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.528435 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1170/2350] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:17.532741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.543100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835044fe-6e24-4e16-8081-bae535d8271e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.548825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.549476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.549752 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.550021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] PATH_INFO: `/v3/projects/93d40ac981fb411a96bd2b902d6ed6e6/users/ce1c59ba654b42cd9a91e99bcca92896/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.565115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d40ac981fb411a96bd2b902d6ed6e6, user_id=ce1c59ba654b42cd9a91e99bcca92896, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.567776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.582380 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1181/2351] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:17 2022] PUT /identity/v3/projects/93d40ac981fb411a96bd2b902d6ed6e6/users/ce1c59ba654b42cd9a91e99bcca92896/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:17.593045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.593326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.593590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.622867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] MFA Rules not processed for user `ce1c59ba654b42cd9a91e99bcca92896`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:17.624117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:17.694364 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1171/2352] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:17.697969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.759360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7713d99-93fb-4b08-8b92-ff72beaa4363 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.764904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.765506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.765778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.766048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.766668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.768669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.798857 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1182/2353] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:17.803381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.817906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d7de-cb3c-42c0-ba27-1c05027eed2f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.886075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.886685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.886982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.887432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.888401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.890319 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.912944 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1172/2354] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:17 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:17.917170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.928270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c68a-33fd-4b65-86b5-b983d7e61fc4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.933247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.934442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.935389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.935665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.936355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.937985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:17.949224 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1183/2355] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:17.954725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:17.965512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64203-ec2a-4101-ab15-6b3281ef1b86 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:17.971211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:17.972032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:17.972310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:17.972573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] PATH_INFO: `/v3/projects/8d152517c28542b8affa9f9dc0ea9095/users/56f3b963323e480eaca6ae9cba80c5cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:17.990405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d152517c28542b8affa9f9dc0ea9095, user_id=56f3b963323e480eaca6ae9cba80c5cc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:17.993105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:18.007967 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1173/2356] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:17 2022] PUT /identity/v3/projects/8d152517c28542b8affa9f9dc0ea9095/users/56f3b963323e480eaca6ae9cba80c5cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:18.011894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:18.021799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c80c8-f906-4f3c-9057-8e5c555d49eb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:18.071245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:18.086629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:18.087403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:18.087868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:18.088401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:18.089095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:18.091017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ccfdd-1f29-41fe-bbe3-cf05d983b571 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:18.101401 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1184/2357] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:18.105354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:18.118854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fc06-7fd8-426b-a5e1-3ac067f710c3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:18.124711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:18.125403 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:18.125698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:18.125994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] PATH_INFO: `/v3/projects/8d152517c28542b8affa9f9dc0ea9095/users/56f3b963323e480eaca6ae9cba80c5cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:18.128170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d152517c28542b8affa9f9dc0ea9095, user_id=56f3b963323e480eaca6ae9cba80c5cc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:18.130827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:18.141440 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1174/2358] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:18 2022] PUT /identity/v3/projects/8d152517c28542b8affa9f9dc0ea9095/users/56f3b963323e480eaca6ae9cba80c5cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:18.152707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:18.153167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:18.153710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:18.182034 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] MFA Rules not processed for user `56f3b963323e480eaca6ae9cba80c5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:18.183232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:18.254902 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1185/2359] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:18.267525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:18.270325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:18.312170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:18.336648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5fb1-a836-4342-b4b1-d40b071419c3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:18.340711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:18.341368 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:18.341638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:18.341907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:18.351132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:18.352596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb659f0-e8a3-4e03-9583-b22f97154695 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:18.362083 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1175/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:18.957339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:19.025042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a115304-24de-41d9-8faa-e3f61ec4e9db None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:19.030609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:19.030953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.031253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.031510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] PATH_INFO: `/v3/users/ce1c59ba654b42cd9a91e99bcca92896` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.033257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1c59ba654b42cd9a91e99bcca92896)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:19.035337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:19.086307 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1c59ba654b42cd9a91e99bcca92896'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.086956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1c59ba654b42cd9a91e99bcca92896'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.095707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1c59ba654b42cd9a91e99bcca92896'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.102679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1c59ba654b42cd9a91e99bcca92896'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.111916 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:19.119862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1c59ba654b42cd9a91e99bcca92896'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.134206 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1186/2361] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:18 2022] DELETE /identity/v3/users/ce1c59ba654b42cd9a91e99bcca92896 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:19.135831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.136197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.136618 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.159152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:19.160495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:19.224306 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1176/2362] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:19.234621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:19.236088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:19.297630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a3f6b-1960-4bf0-a0c1-b49ccb6e50ff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:19.302211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:19.302822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.303094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.303358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.312648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:19.314151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:19.324577 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1187/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:19.600557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:19.602030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:19.615130 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8dd6-eef5-4960-8994-91e3b5be2a82 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:19.620413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:19.621164 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.621412 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.621683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] PATH_INFO: `/v3/projects/93d40ac981fb411a96bd2b902d6ed6e6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.622890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d40ac981fb411a96bd2b902d6ed6e6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:19.624928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:19.671804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d40ac981fb411a96bd2b902d6ed6e6', 'request_id': 'req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.677181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d40ac981fb411a96bd2b902d6ed6e6', 'request_id': 'req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.685810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d40ac981fb411a96bd2b902d6ed6e6', 'request_id': 'req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.697518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] The token cache is being invalidate because project 93d40ac981fb411a96bd2b902d6ed6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:19.697810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.698509 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.700144 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1177/2364] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:19 2022] DELETE /identity/v3/projects/93d40ac981fb411a96bd2b902d6ed6e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:19.704445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:19.714602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dde89-d78d-4524-8ca9-eb2d31d0eada service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:19.773578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:19.774219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:19.774493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:19.774764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] PATH_INFO: `/v3/users/56f3b963323e480eaca6ae9cba80c5cc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:19.776038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f3b963323e480eaca6ae9cba80c5cc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:19.778293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:19.832055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f3b963323e480eaca6ae9cba80c5cc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.832639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f3b963323e480eaca6ae9cba80c5cc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.841143 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f3b963323e480eaca6ae9cba80c5cc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.850203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f3b963323e480eaca6ae9cba80c5cc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.866191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-96552610-71f7-4ad9-99a4-6492e3c69695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f3b963323e480eaca6ae9cba80c5cc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:19.875764 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:19 2022] DELETE /identity/v3/users/56f3b963323e480eaca6ae9cba80c5cc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:20.173259 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.174837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:20.189263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8387b-b0bd-48bd-b83e-10fd7610d84d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.243723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:20.250837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.252139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.252646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.253263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] PATH_INFO: `/v3/projects/8d152517c28542b8affa9f9dc0ea9095` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.254892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d152517c28542b8affa9f9dc0ea9095)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.258336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.311143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d152517c28542b8affa9f9dc0ea9095', 'request_id': 'req-507583aa-8f2c-4827-b857-54d5dd941715'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:20.319774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d152517c28542b8affa9f9dc0ea9095', 'request_id': 'req-507583aa-8f2c-4827-b857-54d5dd941715'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:20.328673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d152517c28542b8affa9f9dc0ea9095', 'request_id': 'req-507583aa-8f2c-4827-b857-54d5dd941715'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:20.340987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] The token cache is being invalidate because project 8d152517c28542b8affa9f9dc0ea9095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:20.341257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:20.341967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-507583aa-8f2c-4827-b857-54d5dd941715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:20.343903 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1178/2366] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:20 2022] DELETE /identity/v3/projects/8d152517c28542b8affa9f9dc0ea9095 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:20.349306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.349870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.349870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.371478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:20.373040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:20.382331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:20.439184 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1189/2367] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:20.447090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.447350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.447644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.469799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:20.471060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:20.479971 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1179/2368] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:20.485067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.495083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e87c4-7984-4c8e-b4a1-8870ab9c8886 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.500120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.500723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.501005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.501273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.501926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:20.502398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.504002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.515847 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1190/2369] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:20.520361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.529560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a403ae-2dfa-47cc-a5d9-511a0a68434f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.535140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.535778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.536095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.536364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.536990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.538878 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.569290 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1180/2370] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:20.573867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.584172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1489-8f2f-4016-9048-5791cd4b5647 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.657083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.658015 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.658288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.658550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.659178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.661152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.689572 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1191/2371] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:20.695376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.707129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d246e16-e224-4e59-97f2-ae1cfe3392ad admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.713157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.713759 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.714026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.714300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.714969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.716637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.728484 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1181/2372] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:20.733117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.743728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f590f-38fc-4226-b33f-af2c05e0e6d6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.748639 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.749237 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.749603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.750036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.750921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.752577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11963321-4355-4297-9d18-6c8018a8c338 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.763121 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1192/2373] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:20.767542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.777718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381421b0-52a4-471b-8094-57bf88bb565d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:20.783365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:20.784041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.784313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.784577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] PATH_INFO: `/v3/projects/0331a5f329b444b6a6744d16be86878a/users/d1ba6498eced4694bae98777e1facb59/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.800019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0331a5f329b444b6a6744d16be86878a, user_id=d1ba6498eced4694bae98777e1facb59, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:20.802951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:20.817419 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1182/2374] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:20 2022] PUT /identity/v3/projects/0331a5f329b444b6a6744d16be86878a/users/d1ba6498eced4694bae98777e1facb59/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:20.827506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:20.827932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:20.828224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:20.858409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] MFA Rules not processed for user `d1ba6498eced4694bae98777e1facb59`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:20.860000 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:20.930403 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1193/2375] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:20.935288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:20.999586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9a11-3c61-4c72-b12f-a4bad570fae5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.005235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.005848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.006120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.006401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.007033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.009049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.046781 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1183/2376] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:20 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:21.048215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.061725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be5a6-d9bb-48d6-b92e-fd78e14d3cf4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.068076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:21.145629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.146777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.147389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.148087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.149133 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.151659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a66e22-2a91-4c2b-8d81-f745e73944c2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.181593 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1194/2377] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:21 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:21.185756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.199092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4ff5-2613-4092-b200-0e19cce4d36e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.204630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.205532 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.205816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.206085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.207171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.209235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.211785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:21.219022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.219385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.219541 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.226105 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1184/2378] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:21.230363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.241328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a37c-799b-48c6-aca0-41ee5fd8b447 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.246605 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:21.246735 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.247012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.247286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.247390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:21.247697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] PATH_INFO: `/v3/projects/d21ad04f20524abd9b6517f739a995dc/users/bba169de538b47f684efff69cc9060cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.265201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21ad04f20524abd9b6517f739a995dc, user_id=bba169de538b47f684efff69cc9060cc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.269030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.284258 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1185/2379] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:21 2022] PUT /identity/v3/projects/d21ad04f20524abd9b6517f739a995dc/users/bba169de538b47f684efff69cc9060cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:21.288082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.314941 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1195/2380] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:21.357545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c75f0-4545-41b2-b8c3-138d184dd445 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.362662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.363276 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.363549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.364018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.364684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.366266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.366962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.368642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:21.377183 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1186/2381] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:14:21.381231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.391944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e06814-ca3d-498c-b4ce-3458e78e788f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.397069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.397802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.398076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.398342 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] PATH_INFO: `/v3/projects/d21ad04f20524abd9b6517f739a995dc/users/bba169de538b47f684efff69cc9060cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.400310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21ad04f20524abd9b6517f739a995dc, user_id=bba169de538b47f684efff69cc9060cc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.403347 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82255294-0ee4-4e40-96c5-c34921f15d6e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.415123 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1187/2382] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:21 2022] PUT /identity/v3/projects/d21ad04f20524abd9b6517f739a995dc/users/bba169de538b47f684efff69cc9060cc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:21.426809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.427167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.427503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.447434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb9e7d-e133-4ba1-a0d9-f9b27d9f05e7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.455983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] MFA Rules not processed for user `bba169de538b47f684efff69cc9060cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:21.457178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:21.495910 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:21.518124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.518699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.518985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.519209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.533981 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1188/2383] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:21.547876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.549538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:21.584480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.586096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.595650 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1196/2384] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:14:21.605267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:21.631373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894bfd-059d-4917-b760-b1b03e2e4c54 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.635136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.635770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.636089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.636363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.650464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.652016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.664251 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1189/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:21.787517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:21.797560 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e0ae-cff7-4fd8-8281-7bb580c3e6ff service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:21.801211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:21.801821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:21.802096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:21.802366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:21.866423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:21.868032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178e09e-e7bf-4b89-b099-e436c63d5812 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:21.880084 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1197/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:22.195711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:22.265954 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3a6b-0168-4b96-832c-9022712d7570 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:22.271633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:22.272510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:22.272785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:22.273069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] PATH_INFO: `/v3/users/d1ba6498eced4694bae98777e1facb59` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:22.274206 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ba6498eced4694bae98777e1facb59)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:22.276196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:22.339019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ba6498eced4694bae98777e1facb59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:22.351893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ba6498eced4694bae98777e1facb59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:22.363887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ba6498eced4694bae98777e1facb59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:22.364877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ba6498eced4694bae98777e1facb59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:22.365906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ba6498eced4694bae98777e1facb59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:22.381182 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1190/2387] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:22 2022] DELETE /identity/v3/users/d1ba6498eced4694bae98777e1facb59 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:22.386296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:22.386866 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:22.387006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:22.407665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:22.409057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:22.477075 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1198/2388] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:22.487654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:22.489151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:22.554287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195a1b-b22e-4f0e-8c6b-16579f600504 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:22.560609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:22.561336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:22.561685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:22.562211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:22.574710 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:22.575387 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:22.587244 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1191/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:22.987380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:22.988888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:23.001985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c98335-2052-419a-b557-00b584a7fc1a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:23.031399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:23.032537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:23.032816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:23.033087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] PATH_INFO: `/v3/projects/0331a5f329b444b6a6744d16be86878a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:23.034578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0331a5f329b444b6a6744d16be86878a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:23.036550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:23.064371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:23.097465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0331a5f329b444b6a6744d16be86878a', 'request_id': 'req-08821ae0-363b-4313-b3b0-2071a63d8c80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.104441 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0331a5f329b444b6a6744d16be86878a', 'request_id': 'req-08821ae0-363b-4313-b3b0-2071a63d8c80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.113116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0331a5f329b444b6a6744d16be86878a', 'request_id': 'req-08821ae0-363b-4313-b3b0-2071a63d8c80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.127793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] The token cache is being invalidate because project 0331a5f329b444b6a6744d16be86878a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:23.128072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.128703 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.130244 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1199/2390] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:22 2022] DELETE /identity/v3/projects/0331a5f329b444b6a6744d16be86878a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:23.134344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:23.149874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f152c0-2b8a-47cc-8be7-2fb8440acce3 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:23.155195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:23.221729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:23.223174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:23.223633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:23.224158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] PATH_INFO: `/v3/users/bba169de538b47f684efff69cc9060cc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:23.225285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba169de538b47f684efff69cc9060cc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:23.227385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:23.296179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba169de538b47f684efff69cc9060cc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.311713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba169de538b47f684efff69cc9060cc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.322386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba169de538b47f684efff69cc9060cc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.322979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba169de538b47f684efff69cc9060cc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.323888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a09fe03e-84f8-4dcd-9a26-2b556d7bb54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba169de538b47f684efff69cc9060cc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.338502 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1192/2391] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:23 2022] DELETE /identity/v3/users/bba169de538b47f684efff69cc9060cc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:23.662521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:23.664576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:23.680994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821ae0-363b-4313-b3b0-2071a63d8c80 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:23.753802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:23.754479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:23.754755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:23.755024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] PATH_INFO: `/v3/projects/d21ad04f20524abd9b6517f739a995dc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:23.756189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21ad04f20524abd9b6517f739a995dc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:23.758248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:23.820628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21ad04f20524abd9b6517f739a995dc', 'request_id': 'req-f4041ea1-bb38-4394-81f5-55d0eeb64122'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.828584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21ad04f20524abd9b6517f739a995dc', 'request_id': 'req-f4041ea1-bb38-4394-81f5-55d0eeb64122'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.838730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21ad04f20524abd9b6517f739a995dc', 'request_id': 'req-f4041ea1-bb38-4394-81f5-55d0eeb64122'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.859903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] The token cache is being invalidate because project d21ad04f20524abd9b6517f739a995dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:23.860623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.861553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f4041ea1-bb38-4394-81f5-55d0eeb64122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:23.863207 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1200/2392] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:23 2022] DELETE /identity/v3/projects/d21ad04f20524abd9b6517f739a995dc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:23.868485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:23.869031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:23.869526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:23.892468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:23.893762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:23.967941 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1193/2393] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:23.975137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:23.975654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:23.976092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:23.996097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:23.997553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:23.999723 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:24.001098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:24.009554 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1201/2394] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:24.015156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.025467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4e5f-08d1-4e4e-a3d2-ed8863509a24 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.032759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.033460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.033736 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.034001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.034662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:24.034962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.035642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:24.036717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.058153 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1202/2395] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:24.059051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.071073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d78d7-3f1a-47eb-9a91-ca18197675b8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.083112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.083929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.084387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.084606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.085764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.088894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.103638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caadf9-4ed8-4c81-8f25-507068cddacb None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.111835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.112811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.113089 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.113357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.114874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:24.115705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:24.131645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1203/2396] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:24 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:24.132969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.217313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.217313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.232132 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372b7a5-56a6-4109-b24d-335ac1b7b5f4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.232694 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1194/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:24.241513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.242158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.242434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.242728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.243401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.245428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.279796 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1204/2398] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:24 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:24.287845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.310258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becc7f0-f4d4-4f8c-ba56-27327154e8fa service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.315506 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.316166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.316439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.316705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.317555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.328166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.335133 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1195/2399] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:24.336495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.348302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee895-6fa0-4446-a540-e192a3fc7280 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.355024 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.355654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.355960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.356227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.356881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.358502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3575106-4b7c-435e-a77f-502adadbf08b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.370884 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1205/2400] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:24.376756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.390782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6210-b925-4029-99f2-6e6355d66ea9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.396050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.396761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.397040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.397314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] PATH_INFO: `/v3/projects/cf6be7141b134a009c5e763215919860/users/4886a27dda0f4434ad5bc60c9192116d/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.417199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6be7141b134a009c5e763215919860, user_id=4886a27dda0f4434ad5bc60c9192116d, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.425390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.438729 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1196/2401] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:24 2022] PUT /identity/v3/projects/cf6be7141b134a009c5e763215919860/users/4886a27dda0f4434ad5bc60c9192116d/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:24.449269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.449620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.449973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.491319 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] MFA Rules not processed for user `4886a27dda0f4434ad5bc60c9192116d`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:24.492874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:24.569029 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1206/2402] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:24.579635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.581470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:24.652066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3019-a023-465e-be99-46ab9b2169b7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.656971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.658032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.658333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.658591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.668594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.670052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eacbc-3349-4a7b-a60f-117d94ed57e0 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.687070 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1197/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:24.712051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:24.799272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc1e4-6445-4b92-998b-2e73c9cfa658 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:24.804246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:24.804968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.805308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.805649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] PATH_INFO: `/v3/users/4886a27dda0f4434ad5bc60c9192116d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.806867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4886a27dda0f4434ad5bc60c9192116d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:24.808922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:24.815096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:24.867865 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4886a27dda0f4434ad5bc60c9192116d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:24.868521 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4886a27dda0f4434ad5bc60c9192116d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:24.878998 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4886a27dda0f4434ad5bc60c9192116d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:24.887053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4886a27dda0f4434ad5bc60c9192116d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:24.902974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4886a27dda0f4434ad5bc60c9192116d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:24.910036 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1207/2404] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:24 2022] DELETE /identity/v3/users/4886a27dda0f4434ad5bc60c9192116d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:24.915436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:24.915436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:24.915436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:24.937793 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:24.939213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:24.971027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:25.019333 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1198/2405] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:14:25.031827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.033628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:25.114095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988583c-70da-48e1-ba56-cb473614e733 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.118864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.119794 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.120298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.120666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.131448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:25.133100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ba7f-14a7-40bf-b372-97dc9d694137 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:25.145835 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1208/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:25.456595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.458861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:25.486902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b40f9-b4a7-4895-9cbe-1c7816884a96 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.498926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.500291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.500593 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.500847 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] PATH_INFO: `/v3/projects/cf6be7141b134a009c5e763215919860` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.504474 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6be7141b134a009c5e763215919860)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:25.506455 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:25.570153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6be7141b134a009c5e763215919860', 'request_id': 'req-98dcb32d-729b-4743-ac56-f02cdf9b4db0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:25.576375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6be7141b134a009c5e763215919860', 'request_id': 'req-98dcb32d-729b-4743-ac56-f02cdf9b4db0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:25.586248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6be7141b134a009c5e763215919860', 'request_id': 'req-98dcb32d-729b-4743-ac56-f02cdf9b4db0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:25.605621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] The token cache is being invalidate because project cf6be7141b134a009c5e763215919860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:25.605958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:25.607649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-98dcb32d-729b-4743-ac56-f02cdf9b4db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:25.609951 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1199/2407] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:25 2022] DELETE /identity/v3/projects/cf6be7141b134a009c5e763215919860 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:25.616467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.616858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.617199 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.639368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:25.640981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:25.726336 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1209/2408] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:25.733876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617209e4-d640-4161-b800-7425a9d8378d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.734181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617209e4-d640-4161-b800-7425a9d8378d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.734421 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617209e4-d640-4161-b800-7425a9d8378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.758358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-617209e4-d640-4161-b800-7425a9d8378d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:25.759932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-617209e4-d640-4161-b800-7425a9d8378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:25.772011 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1200/2409] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:25.776277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.788212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a729-7f3b-4dcd-a9c7-5d9172b7a4db None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.793450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.794063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.794337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.794602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.795247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:25.795542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:25.797263 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:25.813956 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1210/2410] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:14:25.815141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617209e4-d640-4161-b800-7425a9d8378d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.825418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617209e4-d640-4161-b800-7425a9d8378d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.830216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.830988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.831262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.831524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.832321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:25.834210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:25.865018 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1201/2411] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:25 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:25.869116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.880282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0085b9-8708-479b-9a26-02085519941b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.893657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:25.947811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.948867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.949371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.949739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:25.950472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:25.952681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:25.979530 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1211/2412] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:25 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:14:25.980948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:25.992792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9090-0025-4217-8868-d1cb88ce5f75 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:25.997827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:25.998561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:25.998927 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:25.999599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.000234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.001998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.013575 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1202/2413] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:26.017526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:26.028288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c858-e0c2-400a-81fc-4119c5aaaf13 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:26.033972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:26.034585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.034855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.035124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.035792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.037407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391b3b9-955a-4ef9-8fc1-95cc47bf96ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.049150 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1212/2414] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:26.053427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:26.068129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670a138-5846-436e-8458-763de9554c7c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:26.074266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:26.074938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.075272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.075607 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] PATH_INFO: `/v3/projects/cbcdfcff05d54cf983146905bea201e0/users/fc5efeed3f51461b9f54b667acacbcad/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.096062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcdfcff05d54cf983146905bea201e0, user_id=fc5efeed3f51461b9f54b667acacbcad, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.098857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.115463 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1203/2415] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:26 2022] PUT /identity/v3/projects/cbcdfcff05d54cf983146905bea201e0/users/fc5efeed3f51461b9f54b667acacbcad/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:14:26.129686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.130104 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.130471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.166134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] MFA Rules not processed for user `fc5efeed3f51461b9f54b667acacbcad`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:26.167862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:26.247207 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1213/2416] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:26.254468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:26.257861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:26.334409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964b7f-f613-4f12-aff7-643d186188af admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:26.338096 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:26.338705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.338975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.339237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.344928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:26.349422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.351750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e4e60-8046-47b4-972e-e3fca004e8ae service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.365381 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1204/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:26.392732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:26.475596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdf376-6f0d-4669-9a46-881bc6ee71af None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:26.480503 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:26.481272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.481546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.481810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] PATH_INFO: `/v3/users/fc5efeed3f51461b9f54b667acacbcad` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.482930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5efeed3f51461b9f54b667acacbcad)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.485515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.525857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:26.560930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5efeed3f51461b9f54b667acacbcad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:26.562956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5efeed3f51461b9f54b667acacbcad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:26.571915 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5efeed3f51461b9f54b667acacbcad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:26.580862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5efeed3f51461b9f54b667acacbcad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:26.594286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5efeed3f51461b9f54b667acacbcad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:26.603127 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1214/2418] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:26 2022] DELETE /identity/v3/users/fc5efeed3f51461b9f54b667acacbcad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:26.607538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.608178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.608178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.628951 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:26.630155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:26.700691 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1205/2419] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:26.712016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:26.714838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:26.797101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839571-0e67-4ab4-aabc-b8a200bd9d80 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:26.806544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:26.807274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:26.807624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:26.807997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:26.820684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:26.822659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835dcc3-0bb7-4038-ba55-21d7e1784b02 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:26.834666 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1215/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:27.240491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.242980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:27.258052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22416487-ec02-4c8a-bd73-57ddbdf2c553 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.269959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.270727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.272139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] PATH_INFO: `/v3/projects/cbcdfcff05d54cf983146905bea201e0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.273788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcdfcff05d54cf983146905bea201e0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.276324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.336107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcdfcff05d54cf983146905bea201e0', 'request_id': 'req-6784bba0-1dd6-46ad-aaee-451605d29a5f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:27.343673 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcdfcff05d54cf983146905bea201e0', 'request_id': 'req-6784bba0-1dd6-46ad-aaee-451605d29a5f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:27.356948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcdfcff05d54cf983146905bea201e0', 'request_id': 'req-6784bba0-1dd6-46ad-aaee-451605d29a5f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:27.370742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] The token cache is being invalidate because project cbcdfcff05d54cf983146905bea201e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:27.370934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:27.371669 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6784bba0-1dd6-46ad-aaee-451605d29a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:27.375783 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1206/2421] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:27 2022] DELETE /identity/v3/projects/cbcdfcff05d54cf983146905bea201e0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:27.381053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.381460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.381847 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.406474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:27.408433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:27.482120 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1216/2422] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:27.489844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.490168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.490400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.513297 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:27.514528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:27.524384 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1207/2423] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:27.528363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.542010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2428-25da-4128-822e-75b271a5c727 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.547295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.547951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.548229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.548492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.549146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:14:27.549439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.551748 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.570765 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1217/2424] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:14:27.572941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.582957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ec74-0e88-40fa-a7dc-0a61db7265d3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.588338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.589048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.589397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.589664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.590306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.592870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.627825 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1208/2425] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:14:27 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:27.628625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.639395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604f19b-fc6e-4d8d-a61b-59efff5b720e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.673456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:27.705591 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.706373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.706855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.707267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.708028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.710052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.735775 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1218/2426] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:14:27 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:14:27.740138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.750999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968ef36-ef58-406d-be46-eac7bb855f97 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.757907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.758620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.758960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.759300 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.760071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.761773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.773500 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1209/2427] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:27.778518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.791227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd32c-8e95-4485-afd5-549c08fc9cff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.796203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.797419 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.798005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.798005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.798581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.800281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6603c85-58e8-455b-b898-875b9a3a11e1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.814940 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1219/2428] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:14:27.816726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:27.828389 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6ce1-a016-48d3-9c5b-9bd19a8b4dbb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:27.833359 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:27.834101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.834380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.834651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] PATH_INFO: `/v3/projects/8289cb023a004d39816fae029c7a28ed/users/bd986296543c47b3818f3fdfeeff0f5e/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.852144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8289cb023a004d39816fae029c7a28ed, user_id=bd986296543c47b3818f3fdfeeff0f5e, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:27.854796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:27.871881 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1210/2429] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:14:27 2022] PUT /identity/v3/projects/8289cb023a004d39816fae029c7a28ed/users/bd986296543c47b3818f3fdfeeff0f5e/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:27.942684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:27.943058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:27.943394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:27.977741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] MFA Rules not processed for user `bd986296543c47b3818f3fdfeeff0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:27.979459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:28.075494 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1220/2430] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:28.095160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:28.101494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:28.128238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:28.228751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f439e2-2299-43b4-89ad-beef38c57240 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:28.233098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:28.233867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:28.235140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:28.235511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:28.247774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:28.249558 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:28.264780 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1211/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:30.988603 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:30.990057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.000692 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.066606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9656-9900-4037-b17a-03ef15c54a3a service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.071384 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.072036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.072423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.072694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] PATH_INFO: `/v3/users/bd986296543c47b3818f3fdfeeff0f5e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.073371 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffd9d-da79-47a7-9ee9-577d7c2b6f31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.073841 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd986296543c47b3818f3fdfeeff0f5e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.075765 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.079933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.080550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.080827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.081096 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.082949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.123380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd986296543c47b3818f3fdfeeff0f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.125677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:31.135798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd986296543c47b3818f3fdfeeff0f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.143989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd986296543c47b3818f3fdfeeff0f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.144614 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd986296543c47b3818f3fdfeeff0f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.145298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a530d65d-13ba-4228-8d47-be05fc9e1512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd986296543c47b3818f3fdfeeff0f5e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.148171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.149957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.158307 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1212/2432] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:14:30 2022] DELETE /identity/v3/users/bd986296543c47b3818f3fdfeeff0f5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:31.160298 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1221/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:31.162965 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.163305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.163582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.183665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:31.184887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.215616 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:31.247893 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1213/2434] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:31.258417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.260604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.335178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf0b5-6a55-4b51-aa98-c75795723d2b service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.389468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.390259 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.391208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.391485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.402585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.404064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.416394 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1222/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:31.522866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.525704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.543985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50dcc8-ffe1-4a2c-a261-007204d2d3d6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.548487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.549104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.549374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.549638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.551473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.562801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.564268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.573770 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1214/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:31.745434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:31.747379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:31.765656 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030e7f-5f7e-490e-877d-ea6f82037c17 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:31.770968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:31.772420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:31.772694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:31.772963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] PATH_INFO: `/v3/projects/8289cb023a004d39816fae029c7a28ed` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:31.774531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8289cb023a004d39816fae029c7a28ed)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:31.776150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:31.853787 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8289cb023a004d39816fae029c7a28ed', 'request_id': 'req-5789f19a-0bc6-4264-b977-ace18f3145c7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.859362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8289cb023a004d39816fae029c7a28ed', 'request_id': 'req-5789f19a-0bc6-4264-b977-ace18f3145c7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.867508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8289cb023a004d39816fae029c7a28ed', 'request_id': 'req-5789f19a-0bc6-4264-b977-ace18f3145c7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.882934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] The token cache is being invalidate because project 8289cb023a004d39816fae029c7a28ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:14:31.883311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.884038 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5789f19a-0bc6-4264-b977-ace18f3145c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:14:31.885595 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1223/2437] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:31 2022] DELETE /identity/v3/projects/8289cb023a004d39816fae029c7a28ed => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:14:35.461626 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:35.463145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.535406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6cdb0-4667-4dc1-bc61-1d82740d2c77 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:35.598427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:35.599011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:35.599334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:35.599596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:35.601576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:35.613210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:35.614818 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:35.624729 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1215/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:37.390629 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:37.391179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:37.391179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:37.412712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:37.413927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:37.428568 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:37.483391 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1224/2439] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:37.497162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:37.498742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:37.565369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:37.582867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffad1a-1001-4411-a79f-266fff667108 service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:37.589345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:37.589981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:37.590262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:37.590529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:37.599995 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:37.601609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:37.610009 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1216/2440] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:14:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:14:38.964060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:38.965654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:39.049857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584f89-f95c-4024-b3cd-c3be9c5207fb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:39.055873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:39.056460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:39.056733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:39.057150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:39.059067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:39.121926 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:39.123596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:39.145134 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1225/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:47.606817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:49.129311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=72 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:51.372732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:51.374391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:51.392490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ff26-4ccc-415e-8009-0d8a5e1b8987 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:51.398886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:51.399501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:51.399934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:51.400241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:51.402270 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:51.415690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:51.417323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd5290-5fb9-4c4c-ab30-f68794170248 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:51.428565 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1217/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:54.434537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:54.449429 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4703-7722-4639-aab1-a736d6fdef7b service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:54.456018 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:54.456635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:54.456911 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:54.457201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:54.459065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:54.473941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:54.475921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:54.503042 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1226/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:14:55.894917 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:55.895407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:55.895520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:55.916483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:14:55.917739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:14:55.926203 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1218/2444] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:14:55.938575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:14:55.950122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de531d2-51e1-49ef-adf2-a0b0ad1e119b service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:14:55.955729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:14:55.956438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:14:55.956716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:14:55.956983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:14:55.965351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:14:55.966850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:14:55.974779 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1227/2445] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:01.841656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:01.843258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:01.904348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ded22-90d7-45d5-8ddb-d7a13412afa8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:01.908459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:01.909124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:01.909394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:01.909663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:01.911482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:01.976346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:01.977791 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:01.988179 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1219/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:02.916698 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:02.918799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:02.931305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdca5a-f1bf-48e1-91bc-c082327a64c3 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:02.935622 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:02.936278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:02.936547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:02.937021 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:02.938813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:02.952025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:02.953563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:02.966037 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1228/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:05.397166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:05.400151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:05.418588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9787404-bc71-4b2b-b64e-241bd500d0cd service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:05.429333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:05.430237 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:05.430524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:05.430797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:05.433663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:05.453900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:05.455773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:05.469244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:05.470682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:05.485006 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1220/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:05.493163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99238b-3784-4fff-b020-9d0179fda570 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:05.500654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:05.501590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:05.502513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:05.503148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] PATH_INFO: `/v3/users/e848774140534fb3bf35d9197ed444a5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:05.504962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e848774140534fb3bf35d9197ed444a5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:05.508870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:05.574181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e848774140534fb3bf35d9197ed444a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.574840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e848774140534fb3bf35d9197ed444a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.583706 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e848774140534fb3bf35d9197ed444a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.592234 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e848774140534fb3bf35d9197ed444a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.604803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1c1119d-8f32-40ae-9609-78d4e278e5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e848774140534fb3bf35d9197ed444a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.611380 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1229/2449] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:05 2022] DELETE /identity/v3/users/e848774140534fb3bf35d9197ed444a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:05.802834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:05.815646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967883-1c35-4b2d-ad7d-cc64686b7fdb service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:05.898553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:05.899207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:05.899487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:05.899771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] PATH_INFO: `/v3/projects/a156a4b86c914a04b4d18a91759779b6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:05.900894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a156a4b86c914a04b4d18a91759779b6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:05.904045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:05.928610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:05.961827 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a156a4b86c914a04b4d18a91759779b6', 'request_id': 'req-99cc6c8b-d323-40bc-a6ec-f1459ec23839'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.969899 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a156a4b86c914a04b4d18a91759779b6', 'request_id': 'req-99cc6c8b-d323-40bc-a6ec-f1459ec23839'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.982154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a156a4b86c914a04b4d18a91759779b6', 'request_id': 'req-99cc6c8b-d323-40bc-a6ec-f1459ec23839'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.994382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] The token cache is being invalidate because project a156a4b86c914a04b4d18a91759779b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:05.994672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.995309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-99cc6c8b-d323-40bc-a6ec-f1459ec23839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:05.997449 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1221/2450] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:05 2022] DELETE /identity/v3/projects/a156a4b86c914a04b4d18a91759779b6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:06.002324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.002688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.003028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.023212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:06.024608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:06.094293 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1230/2451] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:06.103443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.103723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.104024 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.126339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:06.127565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:06.137299 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1222/2452] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:06.141180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.151693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043252ae-2f79-4716-a368-8a99791d1da0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.158114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.158734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.159008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.159280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.159969 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:06.160255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.161877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.178615 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1231/2453] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:06.179943 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.192174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8ff6-72d6-4fb8-86c4-d659ac775b8d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.198154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.199293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.199585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.200663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.201520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.204050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.236629 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1223/2454] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:06 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:06.240700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.253106 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa479b1-563c-4960-a16b-b3ee0caabbe0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.276177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:06.349120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.349745 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.350025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.350294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.351122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.356644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.382116 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1232/2455] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:06 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:06.385901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.402631 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99851-ec6a-4579-b1c4-338fb9e9a748 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.411396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.412144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.412587 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.412863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.413525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.415328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.426939 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1224/2456] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:06.431094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.442612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffb08b-4d86-4e47-9772-020e461177b4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.448927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.449979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.450421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.451188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.451565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.454339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10a61f-bbfd-4a8d-a76b-3c3f49c667ee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.473532 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1233/2457] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:06.478072 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.491052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d51b60-71ad-4cd0-a18c-878f7ebf3635 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.497225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.498801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.499273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.499734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] PATH_INFO: `/v3/projects/871af348d8524be585b51b8ec31ff67d/users/c2d24b1a0ba24e9693ebadeb0c711c54/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.518585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] RBAC: Authorizing `identity:create_grant(project_id=871af348d8524be585b51b8ec31ff67d, user_id=c2d24b1a0ba24e9693ebadeb0c711c54, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.522303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.540152 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1225/2458] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:06 2022] PUT /identity/v3/projects/871af348d8524be585b51b8ec31ff67d/users/c2d24b1a0ba24e9693ebadeb0c711c54/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:06.552443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.553116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.553867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.605726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] MFA Rules not processed for user `c2d24b1a0ba24e9693ebadeb0c711c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:06.607278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:06.713244 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1234/2459] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:06.732937 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.735369 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:06.774758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:06.777149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:06.821776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fe92-ad1a-4b46-b4af-01f5a88d332d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.827897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.828573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.828907 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.829235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.836941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.838630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.845585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc6fc-f676-4e9d-95aa-cab36c02d456 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:06.848495 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1226/2460] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:06.850720 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:06.851452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:06.851864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:06.852222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] PATH_INFO: `/v3/users/bfe5047fd5fc46f9bd9ed3c037c554ab` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:06.853658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe5047fd5fc46f9bd9ed3c037c554ab)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:06.856022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:06.893153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:06.907777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe5047fd5fc46f9bd9ed3c037c554ab'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:06.908435 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe5047fd5fc46f9bd9ed3c037c554ab'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:06.916086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe5047fd5fc46f9bd9ed3c037c554ab'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:06.922980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe5047fd5fc46f9bd9ed3c037c554ab'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:06.939300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-109d04c2-5050-4790-944b-f13351527be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe5047fd5fc46f9bd9ed3c037c554ab'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:06.945478 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1235/2461] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:06 2022] DELETE /identity/v3/users/bfe5047fd5fc46f9bd9ed3c037c554ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:07.137149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.152375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95105a66-a4e4-41fd-8d26-bdd605a97f47 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.194448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:07.238316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.238964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.239243 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.239510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] PATH_INFO: `/v3/projects/2b012f0f3d40474f8b672dc6bfbff24d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.240684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b012f0f3d40474f8b672dc6bfbff24d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.242762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.295690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b012f0f3d40474f8b672dc6bfbff24d', 'request_id': 'req-f9d62302-bb22-4666-b77c-c4da79177c95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:07.301144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b012f0f3d40474f8b672dc6bfbff24d', 'request_id': 'req-f9d62302-bb22-4666-b77c-c4da79177c95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:07.308989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b012f0f3d40474f8b672dc6bfbff24d', 'request_id': 'req-f9d62302-bb22-4666-b77c-c4da79177c95'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:07.320462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] The token cache is being invalidate because project 2b012f0f3d40474f8b672dc6bfbff24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:07.320776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:07.321408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f9d62302-bb22-4666-b77c-c4da79177c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:07.322922 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1227/2462] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:07 2022] DELETE /identity/v3/projects/2b012f0f3d40474f8b672dc6bfbff24d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:07.328389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.328702 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.329035 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.350986 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:07.352243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:07.411503 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1236/2463] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:07.421183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.421742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.421742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.441799 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:07.443045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:07.452517 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1228/2464] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:07.456812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.466763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43b089-78c6-48ee-bc65-694352bd2c5e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.471536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.472164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.472440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.472710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.473366 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:07.473669 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.475285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.487312 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1237/2465] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:15:07.491714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.501365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01cc12-61ff-4925-bcbb-8cbdbfe997ba None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.506306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.506861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.507132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.507405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.508065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.509987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.538677 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1229/2466] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:07.543022 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.554316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18060c-084b-4d63-9f9d-a69723fc8fad admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.620642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.621290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.621562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.621827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.622452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.624434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.649666 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1238/2467] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:07.654199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.664694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da445d-1677-41b2-bc3a-3a65e363f632 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.669538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.670144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.670418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.670687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.671329 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.672959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.683176 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1230/2468] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:07.688785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.704047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28ef40-720c-4b16-a6f5-3110871afa0c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.711412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.712313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.712638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.712901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.713772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.716032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321ada-3c7e-473b-ae45-130e86a54ea3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.727429 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1239/2469] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:07.731963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.743044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758ba1-04e6-4d05-8a38-1b5559779ded admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.749084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.749737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.749991 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.750277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] PATH_INFO: `/v3/projects/51abe411fc0e42a7b299564d5911cb55/users/a1ff13bf43ae4d0da4d98de083b6e0f2/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.768563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51abe411fc0e42a7b299564d5911cb55, user_id=a1ff13bf43ae4d0da4d98de083b6e0f2, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.771613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:07.788822 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1231/2470] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:07 2022] PUT /identity/v3/projects/51abe411fc0e42a7b299564d5911cb55/users/a1ff13bf43ae4d0da4d98de083b6e0f2/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:07.802946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.803230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.803527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.829308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:07.833240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] MFA Rules not processed for user `a1ff13bf43ae4d0da4d98de083b6e0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:07.835583 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:07.904894 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1240/2471] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:07.912582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:07.975613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:07.982360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e17f50-8d7b-46b4-bee7-e7aa7466e275 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:07.988016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:07.988623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:07.988896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:07.989162 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:07.989782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:07.991679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.023803 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1232/2472] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:07 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:08.028552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.040742 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bd0d-a358-4590-82ae-e4b157bec036 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.100558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.101171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.101443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.101710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.102339 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.104321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.128644 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1241/2473] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:08 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:08.134394 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.146911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d3aa-5ed4-4005-b938-40aa4c5cccf8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.154449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.155511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.156001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.156491 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.157923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.159526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.171098 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1233/2474] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:08.175574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.185768 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ef1f-1169-49b1-870c-d1de4b7e6c7e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.191150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.192200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.192306 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.192544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] PATH_INFO: `/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4/users/624d3c99ce0c42a68797d8d7f74f5c59/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.209279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1a28993ff54f098de2a8da7f4a6bd4, user_id=624d3c99ce0c42a68797d8d7f74f5c59, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.212191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.227127 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1242/2475] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:08 2022] PUT /identity/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4/users/624d3c99ce0c42a68797d8d7f74f5c59/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:08.231371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.241993 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de43ef-d483-4e1d-ad84-ce6d55b9ef68 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.310957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.311570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.311874 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.312145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.312790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.314366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2948e24-3a17-4a20-97ad-c5d75159aaa0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.324337 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1234/2476] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:08.328956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.344432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc128c-2856-4d02-8ad2-d1294b062b5a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.349941 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.350599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.350873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.351141 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] PATH_INFO: `/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4/users/624d3c99ce0c42a68797d8d7f74f5c59/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.353526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1a28993ff54f098de2a8da7f4a6bd4, user_id=624d3c99ce0c42a68797d8d7f74f5c59, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.356356 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.367463 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1243/2477] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:08 2022] PUT /identity/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4/users/624d3c99ce0c42a68797d8d7f74f5c59/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:08.379125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.379411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.379687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.409462 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] MFA Rules not processed for user `624d3c99ce0c42a68797d8d7f74f5c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:08.410586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:08.487862 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1235/2478] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:08.500220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.502145 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:08.566712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a257e63-8e5c-4344-94b4-255412d6888e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.571051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.571771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.572173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.572478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.583613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.585136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb5289-1ed2-4517-8594-1fcf3a8ad5c3 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.589184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:08.597409 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1244/2479] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:09.087204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:09.139357 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:09.157051 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6b430-af1b-42d0-b4e1-dbc45679bcda None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:09.165188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:09.166156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:09.166508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:09.166758 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] PATH_INFO: `/v3/users/a1ff13bf43ae4d0da4d98de083b6e0f2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:09.168805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ff13bf43ae4d0da4d98de083b6e0f2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:09.171806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:09.230228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ff13bf43ae4d0da4d98de083b6e0f2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.243311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ff13bf43ae4d0da4d98de083b6e0f2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.252915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ff13bf43ae4d0da4d98de083b6e0f2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.253610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ff13bf43ae4d0da4d98de083b6e0f2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.254352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ff13bf43ae4d0da4d98de083b6e0f2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.271096 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1236/2480] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:09 2022] DELETE /identity/v3/users/a1ff13bf43ae4d0da4d98de083b6e0f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:09.276653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:09.277012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:09.277382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:09.298724 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:09.299981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:09.381330 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1245/2481] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:09.392956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:09.394440 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:09.461850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b06b6-b5c4-4e86-9143-9d426e19b205 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:09.466755 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:09.467365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:09.467637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:09.467931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:09.478690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:09.480187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:09.492548 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1237/2482] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:09.790596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:09.792290 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:09.805901 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c8e35-bfec-4d38-92ed-268adff74e14 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:09.816955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:09.817809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:09.818333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:09.818864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] PATH_INFO: `/v3/projects/51abe411fc0e42a7b299564d5911cb55` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:09.820188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51abe411fc0e42a7b299564d5911cb55)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:09.822289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:09.875497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51abe411fc0e42a7b299564d5911cb55', 'request_id': 'req-503cd5dc-c5de-4404-b5ac-560cb3bbda82'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.881608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51abe411fc0e42a7b299564d5911cb55', 'request_id': 'req-503cd5dc-c5de-4404-b5ac-560cb3bbda82'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.892770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51abe411fc0e42a7b299564d5911cb55', 'request_id': 'req-503cd5dc-c5de-4404-b5ac-560cb3bbda82'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.906029 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] The token cache is being invalidate because project 51abe411fc0e42a7b299564d5911cb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:09.906283 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.907373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:09.909015 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1246/2483] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:09 2022] DELETE /identity/v3/projects/51abe411fc0e42a7b299564d5911cb55 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:09.913318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:09.923985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c4fc-948d-47df-8d02-e999469be376 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:09.982116 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:09.982738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:09.983005 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:09.983268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] PATH_INFO: `/v3/users/624d3c99ce0c42a68797d8d7f74f5c59` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:09.984562 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=624d3c99ce0c42a68797d8d7f74f5c59)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:09.986494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.000577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:10.038087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624d3c99ce0c42a68797d8d7f74f5c59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.050750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624d3c99ce0c42a68797d8d7f74f5c59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.059042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624d3c99ce0c42a68797d8d7f74f5c59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.060208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624d3c99ce0c42a68797d8d7f74f5c59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.060861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7fe835a0-759f-4100-ad42-d5a0ae16d86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624d3c99ce0c42a68797d8d7f74f5c59'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.076964 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1238/2484] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:09 2022] DELETE /identity/v3/users/624d3c99ce0c42a68797d8d7f74f5c59 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:10.368406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.369899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:10.384172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd5dc-c5de-4404-b5ac-560cb3bbda82 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.445598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.446230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.446502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.446770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] PATH_INFO: `/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.447899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1a28993ff54f098de2a8da7f4a6bd4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.449918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.477596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:10.503813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1a28993ff54f098de2a8da7f4a6bd4', 'request_id': 'req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.509649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1a28993ff54f098de2a8da7f4a6bd4', 'request_id': 'req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.518784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1a28993ff54f098de2a8da7f4a6bd4', 'request_id': 'req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.531374 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] The token cache is being invalidate because project 2e1a28993ff54f098de2a8da7f4a6bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:10.532037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.532767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8fc53f30-3106-4028-a3a8-fd3beec1d5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:10.534306 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1247/2485] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:10 2022] DELETE /identity/v3/projects/2e1a28993ff54f098de2a8da7f4a6bd4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:10.540294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.540922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.541574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.574238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:10.576367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:10.649957 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1239/2486] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:10.658661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.659040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.659376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.680023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:10.681314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:10.690499 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1248/2487] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:10.694919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.705165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bcac9-734b-415a-9a3d-97e8a9b6faa4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.709901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.710511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.710789 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.711061 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.711709 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:10.712101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.713691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.729252 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1240/2488] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:10.734109 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.744966 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ea60-6cbf-47c7-989a-60a43ff3a8a3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.750182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.750797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.751070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.751335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.751993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.754020 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.783463 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1249/2489] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:10 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:10.787858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.798472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d9f-47cb-42fc-b253-cf28cec867e3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.862672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.863293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.863567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.863933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.864508 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.866448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.892118 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1241/2490] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:10 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:10.896075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.908968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ceb4-5f73-4319-b709-da83d3465023 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.913997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.914590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.914863 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.915128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.915800 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.917389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.930509 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1250/2491] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:10.932039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.942101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefce7b-c681-47c9-96e9-49f9c400b088 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.946956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.947559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.947860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.948127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.948763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.950738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6f6f3-bc9f-47a4-93c2-10c661ebc7e6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.953679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:10.966427 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1242/2492] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:10.970459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.980637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754430-a4ce-4959-b19e-7f0a72b9550f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.985688 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.986373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.986543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.986802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] PATH_INFO: `/v3/projects/d4d5c06d0b4b4452895578fcfef3f69e/users/8a5befe7f474441195cc90f8a3d96a3c/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.002227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d5c06d0b4b4452895578fcfef3f69e, user_id=8a5befe7f474441195cc90f8a3d96a3c, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.005027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.019773 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1251/2493] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:10 2022] PUT /identity/v3/projects/d4d5c06d0b4b4452895578fcfef3f69e/users/8a5befe7f474441195cc90f8a3d96a3c/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:11.031963 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.032488 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.032787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.062439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] MFA Rules not processed for user `8a5befe7f474441195cc90f8a3d96a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:11.063666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:11.131308 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1243/2494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:11.135996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.200664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df05a-138e-4091-b04d-6df8a64fc7f0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.205852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.206459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.206730 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.206997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.207628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.209581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.242999 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1252/2495] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:11 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:11.247306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.260076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fc65-aef9-461a-89fa-7ec7f80e711e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.327772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.328411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.328683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.328950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.329563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.331496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.354462 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1244/2496] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:11 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:11.358662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.369689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193009b-6911-4cd7-bb61-75f448ebdcbe admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.375452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.376102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.376373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.376658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.377302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.378924 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.390052 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1253/2497] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:11.394263 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.404850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b789-5106-4068-ae02-1f6167988d32 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.410449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.411099 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.411371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.411653 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] PATH_INFO: `/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d/users/609b1b2c7195465dbb454dee9b11bc5c/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.426942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd93d52dd4644ae9ef3cc62dd26287d, user_id=609b1b2c7195465dbb454dee9b11bc5c, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.429701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.443933 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1245/2498] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:11 2022] PUT /identity/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d/users/609b1b2c7195465dbb454dee9b11bc5c/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:11.447930 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.458475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b009b2-b86f-4135-aa52-475f32837b3b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.477867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:11.522399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.522919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.523190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.523450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.524120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.525746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc04bd-0523-4c76-9d24-d6c282888125 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.536937 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1254/2499] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:11.541446 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.552863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940606-d276-4e2d-b797-71b0dcab729a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.558652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.559362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.559816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.560122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] PATH_INFO: `/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d/users/609b1b2c7195465dbb454dee9b11bc5c/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.562213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd93d52dd4644ae9ef3cc62dd26287d, user_id=609b1b2c7195465dbb454dee9b11bc5c, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.564901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.576198 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1246/2500] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:11 2022] PUT /identity/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d/users/609b1b2c7195465dbb454dee9b11bc5c/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:11.591973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.592253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.592522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.623387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] MFA Rules not processed for user `609b1b2c7195465dbb454dee9b11bc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:11.624638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:11.695733 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1255/2501] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:11.710075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.712433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:11.756900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:11.771594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099da05-dc9d-46cb-9a64-f156e84d05fc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.775402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.775967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.776238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.776493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.786076 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.787497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.796889 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1247/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:11.879676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:11.890324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751193-d5af-4fdd-945f-9d30741010f8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:11.894255 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:11.894852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:11.895122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:11.895390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:11.954497 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:11.956040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4e3c1-9d18-4839-b065-5f1052e5fb3e service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:11.965218 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1256/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:12.173163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:12.174184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.239903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f40f0-6242-43c3-84b8-19104a949f58 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:12.245034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:12.245665 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.245941 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.246213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] PATH_INFO: `/v3/users/c2d24b1a0ba24e9693ebadeb0c711c54` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.247606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d24b1a0ba24e9693ebadeb0c711c54)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:12.249588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:12.297929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d24b1a0ba24e9693ebadeb0c711c54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.309365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d24b1a0ba24e9693ebadeb0c711c54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.317702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d24b1a0ba24e9693ebadeb0c711c54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.318363 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d24b1a0ba24e9693ebadeb0c711c54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.318942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d24b1a0ba24e9693ebadeb0c711c54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.330787 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1248/2504] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:12 2022] DELETE /identity/v3/users/c2d24b1a0ba24e9693ebadeb0c711c54 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:12.335500 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.335785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.336064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.356870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:12.358098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.398393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:12.421240 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1257/2505] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:12.431273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:12.432812 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.492775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861d6e-ca3f-4739-9508-761ddb59bd79 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:12.497286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:12.497884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.498136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.498406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.508166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:12.509576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763fc7-eb27-4732-a211-b8946b6f401c service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:12.519067 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1249/2506] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:12.799936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:12.801525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:12.817570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bf668-c8f2-41ee-a2ba-3a3c5d5f3c79 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:12.822532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:12.823163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.823512 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.823697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] PATH_INFO: `/v3/projects/871af348d8524be585b51b8ec31ff67d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.824878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=871af348d8524be585b51b8ec31ff67d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:12.826868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:12.879395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871af348d8524be585b51b8ec31ff67d', 'request_id': 'req-b22af375-ae48-4c3d-9955-74dd330c5e8e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.885077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871af348d8524be585b51b8ec31ff67d', 'request_id': 'req-b22af375-ae48-4c3d-9955-74dd330c5e8e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.892923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871af348d8524be585b51b8ec31ff67d', 'request_id': 'req-b22af375-ae48-4c3d-9955-74dd330c5e8e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.904148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] The token cache is being invalidate because project 871af348d8524be585b51b8ec31ff67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:12.904428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.905039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b22af375-ae48-4c3d-9955-74dd330c5e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:12.906954 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1258/2507] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:12 2022] DELETE /identity/v3/projects/871af348d8524be585b51b8ec31ff67d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:12.912034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:12.912567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:12.912686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:12.922250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:12.935009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:12.936554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:13.005094 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1250/2508] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:13.013318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.013907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.013907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.039852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:13.041779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:13.053990 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1259/2509] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:13.061011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.070871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bced0c-132d-4265-b3de-af335a22f5a7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.075729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.076361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.076955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.077235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.077887 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:13.078185 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.079850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.091574 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1251/2510] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:13.096190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.106036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76817fc-4efe-4907-8c57-6353e5787292 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.112345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.113151 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.113425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.113754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.114676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.117714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.152138 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1260/2511] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:13.157654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.175104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729edd19-8b12-4668-be15-76045ff65ee6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.235105 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.235722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.236022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.236306 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.236931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.238842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.264376 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1252/2512] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:13.265655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.276210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a90b-e301-4d1e-b05c-09a226a5cfe1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.280981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.281963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.282260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.282516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.283169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.284825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.300366 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1261/2513] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:13.301633 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.314229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562558-3eda-4287-b9e2-b3e550053fdb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.319212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.319924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.320296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.320577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.321331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.323212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f045abd-2756-42ce-b95e-464bc1b92119 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.335770 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1253/2514] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:13.340117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.350660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aece43c-d129-4174-9ed4-aafb81ea9731 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.355819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.356628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.357005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.357294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] PATH_INFO: `/v3/projects/e00bab1c59594fa9ba9d17b29e6f0383/users/0b77daadc6714777a02ce585b5e6322a/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.372722 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00bab1c59594fa9ba9d17b29e6f0383, user_id=0b77daadc6714777a02ce585b5e6322a, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.375427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.389274 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1262/2515] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:13 2022] PUT /identity/v3/projects/e00bab1c59594fa9ba9d17b29e6f0383/users/0b77daadc6714777a02ce585b5e6322a/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:13.401766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.401910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.402188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.432026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] MFA Rules not processed for user `0b77daadc6714777a02ce585b5e6322a`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:13.433434 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:13.522817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:13.529489 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1254/2516] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:13.534340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.594564 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e178-12f8-483c-9d38-0a493d42658b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.599770 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.600393 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.600732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.600965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.601602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.603515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.610655 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:13.640009 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1263/2517] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:13.644426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.655351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1bff-2715-4bea-b3d0-26d0ed485a1d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.722039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.722645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.722921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.723191 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.723845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.725762 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.750961 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1255/2518] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:13.756469 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.767882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471e1e-1ed6-43c1-9093-6c9aa101f9ec admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.773006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.773609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.773883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.774150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.774852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.776494 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.787341 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1264/2519] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:13.791672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.802179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81117ba-72ad-442d-9d98-f42bfb9d859e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.807839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.808502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.808832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.809202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] PATH_INFO: `/v3/projects/14f691216f6d4647b8a0a3ccacee5118/users/3da5ae6386874f69b8cac2e2f7b687a5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.824698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f691216f6d4647b8a0a3ccacee5118, user_id=3da5ae6386874f69b8cac2e2f7b687a5, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.827348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.841813 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1256/2520] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:13 2022] PUT /identity/v3/projects/14f691216f6d4647b8a0a3ccacee5118/users/3da5ae6386874f69b8cac2e2f7b687a5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:13.846243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.858268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9323c2-1b0e-49a3-9e94-43dc198c0c5f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.922499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.923023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.923281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.923547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.924226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.925862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6d09-b8ed-45e7-98d0-23a64c22dcaf admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.936483 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1265/2521] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:13.940952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:13.954786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a99f4a-7a58-4422-98c1-9e030d3663e3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:13.960104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:13.960769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.961042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.961311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] PATH_INFO: `/v3/projects/14f691216f6d4647b8a0a3ccacee5118/users/3da5ae6386874f69b8cac2e2f7b687a5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:13.963210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f691216f6d4647b8a0a3ccacee5118, user_id=3da5ae6386874f69b8cac2e2f7b687a5, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:13.966015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:13.976514 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1257/2522] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:13 2022] PUT /identity/v3/projects/14f691216f6d4647b8a0a3ccacee5118/users/3da5ae6386874f69b8cac2e2f7b687a5/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:13.987226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:13.987507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:13.987796 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:14.017089 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] MFA Rules not processed for user `3da5ae6386874f69b8cac2e2f7b687a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:14.018286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:14.094867 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1266/2523] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:14.106741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:14.108837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:14.169303 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b9b5-e361-4bbc-9ba9-ac70096ac297 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:14.173207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:14.173751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:14.174022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:14.174287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:14.183381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:14.185033 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:14.195536 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1258/2524] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:14.284887 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:14.295951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57449ae2-07ae-4fd6-b16c-c04329a08211 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:14.300200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:14.300804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:14.301107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:14.301368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:14.362737 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:14.365470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:14.367250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e3dc5-bfe1-4203-915b-4be48f99c5f4 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1267/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:18.123868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:18.125918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:18.196122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:18.202832 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4697ac-c283-48c3-82ee-bfabcdcdc4b1 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:18.208220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:18.208853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:18.209129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:18.209391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] PATH_INFO: `/v3/users/8a5befe7f474441195cc90f8a3d96a3c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:18.210552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5befe7f474441195cc90f8a3d96a3c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:18.212526 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:18.263495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5befe7f474441195cc90f8a3d96a3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.277022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5befe7f474441195cc90f8a3d96a3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.290147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5befe7f474441195cc90f8a3d96a3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.291325 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5befe7f474441195cc90f8a3d96a3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.292009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5befe7f474441195cc90f8a3d96a3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.307642 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1259/2526] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:18 2022] DELETE /identity/v3/users/8a5befe7f474441195cc90f8a3d96a3c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:18.312552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:18.313027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:18.313224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:18.334687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:18.335957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:18.398947 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1268/2527] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:18.409637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:18.411316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:18.471146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4573f1-6b37-423d-992c-401d75ddcafa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:18.474740 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:18.475350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:18.475671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:18.475923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:18.485690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:18.487056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:18.496874 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1260/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:18.774598 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:18.776795 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:18.792759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026a90-f325-45eb-83b6-8b34cff5aaee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:18.798358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:18.798996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:18.799333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:18.799557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] PATH_INFO: `/v3/projects/d4d5c06d0b4b4452895578fcfef3f69e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:18.800719 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d5c06d0b4b4452895578fcfef3f69e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:18.804355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:18.855726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d5c06d0b4b4452895578fcfef3f69e', 'request_id': 'req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.861348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d5c06d0b4b4452895578fcfef3f69e', 'request_id': 'req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.869314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d5c06d0b4b4452895578fcfef3f69e', 'request_id': 'req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.882499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] The token cache is being invalidate because project d4d5c06d0b4b4452895578fcfef3f69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:18.882840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.883555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:18.885326 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1269/2529] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:18 2022] DELETE /identity/v3/projects/d4d5c06d0b4b4452895578fcfef3f69e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:18.889682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:18.899176 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d35e9-5e5c-48e6-b75e-8376a3e8ed2b service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:18.962344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:18.962686 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:18.962953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:18.963225 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] PATH_INFO: `/v3/users/609b1b2c7195465dbb454dee9b11bc5c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:18.964388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=609b1b2c7195465dbb454dee9b11bc5c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:18.966312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:18.986916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:19.017452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609b1b2c7195465dbb454dee9b11bc5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.030290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609b1b2c7195465dbb454dee9b11bc5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.041229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609b1b2c7195465dbb454dee9b11bc5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.041933 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609b1b2c7195465dbb454dee9b11bc5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.042610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70718186-df40-4a78-b039-0646ec6446ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609b1b2c7195465dbb454dee9b11bc5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.054951 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1261/2530] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:18 2022] DELETE /identity/v3/users/609b1b2c7195465dbb454dee9b11bc5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:19.345609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.347076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:19.361976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3c4e-4e73-40f0-8a78-2dcf165de5ad admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.419970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.420597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.420868 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.421137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] PATH_INFO: `/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.422267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd93d52dd4644ae9ef3cc62dd26287d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.424244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.447647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:19.476033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd93d52dd4644ae9ef3cc62dd26287d', 'request_id': 'req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.481241 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd93d52dd4644ae9ef3cc62dd26287d', 'request_id': 'req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.490123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd93d52dd4644ae9ef3cc62dd26287d', 'request_id': 'req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.501144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] The token cache is being invalidate because project acd93d52dd4644ae9ef3cc62dd26287d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:19.501422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.502030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a1f99de9-94a0-4f70-a088-0bc7c6a76a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:19.503545 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1270/2531] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:19 2022] DELETE /identity/v3/projects/acd93d52dd4644ae9ef3cc62dd26287d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:19.509516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.509990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.510085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.529936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:19.531226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:19.592208 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1262/2532] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:19.600550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.600829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.601098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.623302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:19.624754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:19.633471 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1271/2533] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:19.637806 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.647772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69542f-b239-417b-a236-713d4791ded0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.652431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.653031 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.653304 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.653570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.654212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:19.654505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.656239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.668828 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1263/2534] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:19.673943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.688340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6e2b-0f42-4f94-a2e7-ba7b72992260 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.694335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.694935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.695208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.695471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.696170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.698175 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.727833 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1272/2535] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:19 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:19.734795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.750828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710549d2-66ea-46cd-b5cf-63c214e423b1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.810432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.811078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.811353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.811622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.813573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.814800 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.842088 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1264/2536] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:19 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:19.844068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.855626 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eb87b-1087-4296-968f-a67b0d965eef admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.862140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.862844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.863186 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.863519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.864267 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.865963 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.877322 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1273/2537] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:19.881985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.893151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729cd0f-e788-48d2-b450-abc6e94edaef admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.898630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.899244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.899522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.899824 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.900467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.902201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8a7e-793e-4b00-ab2c-32d1792d9b13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.916875 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1265/2538] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:19.921395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:19.931657 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2521-6deb-479b-96c4-af1c0565a138 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:19.939983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:19.940645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.940920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.941191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] PATH_INFO: `/v3/projects/351325128c384137a55e876832d5eb2e/users/16f4b197022749b0814d180bf4a11c51/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.961116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351325128c384137a55e876832d5eb2e, user_id=16f4b197022749b0814d180bf4a11c51, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:19.963841 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:19.978338 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1274/2539] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:19 2022] PUT /identity/v3/projects/351325128c384137a55e876832d5eb2e/users/16f4b197022749b0814d180bf4a11c51/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:19.990521 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:19.990798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:19.991069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:19.998145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.022181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] MFA Rules not processed for user `16f4b197022749b0814d180bf4a11c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:20.023467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:20.098455 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1266/2540] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:20.103247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.167114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03509e8-0036-429e-8db0-433e76872088 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.172134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.172830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.173085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.173347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.174033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.176046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.204360 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1275/2541] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:20 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:20.208489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.220062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0c399-2858-4cab-ae95-3d9a9e191368 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.282255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.282782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.283054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.283318 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.283967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.285880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.309337 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1267/2542] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:20 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:20.313899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.326014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2607-b781-479f-834c-26d2145cdf08 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.331416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.332086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.332320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.332585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.333229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.335212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.346366 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1276/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:20.350698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.362120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b126-0a64-4593-b83a-33a4226780a1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.367654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.368348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.368624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.368891 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] PATH_INFO: `/v3/projects/809ee071517143daa53cf48777b68bf7/users/53b87cc87bdf4455a2666027374ab226/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.385010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ee071517143daa53cf48777b68bf7, user_id=53b87cc87bdf4455a2666027374ab226, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.387854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.403238 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1268/2544] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:20 2022] PUT /identity/v3/projects/809ee071517143daa53cf48777b68bf7/users/53b87cc87bdf4455a2666027374ab226/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:20.408495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.418649 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcc5e8-e3b9-48be-9c30-ab58e58b59a5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.436158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.487051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.487668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.487978 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.488286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.488947 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.490612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e04e2-0609-48e0-a473-a88365e4714e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.500925 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1277/2545] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:20.505897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.519515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7284d9-c802-4eb1-b1af-9c08e5e94d60 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.524861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.525516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.525788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.526054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] PATH_INFO: `/v3/projects/809ee071517143daa53cf48777b68bf7/users/53b87cc87bdf4455a2666027374ab226/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.528048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ee071517143daa53cf48777b68bf7, user_id=53b87cc87bdf4455a2666027374ab226, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.530728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.542009 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1269/2546] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:20 2022] PUT /identity/v3/projects/809ee071517143daa53cf48777b68bf7/users/53b87cc87bdf4455a2666027374ab226/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:20.552623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.552889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.553161 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.582980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] MFA Rules not processed for user `53b87cc87bdf4455a2666027374ab226`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:20.584243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:20.672751 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1278/2547] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:20.684059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:20.685999 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:20.738492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.751651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef0443-6b9d-4b24-8288-289de084c6c2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:20.755475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:20.756124 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:20.756385 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:20.756674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:20.815811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:20.817187 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159fba4-3a35-4a45-972c-18fe9c7d62ed service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:20.826255 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1270/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:21.307318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:21.308845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:21.375665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7918c-fd81-460e-b790-2c27d8c82166 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:21.380703 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:21.381330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:21.381602 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:21.381874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] PATH_INFO: `/v3/users/0b77daadc6714777a02ce585b5e6322a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:21.383056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b77daadc6714777a02ce585b5e6322a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:21.385030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:21.432422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:21.435238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b77daadc6714777a02ce585b5e6322a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:21.436305 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b77daadc6714777a02ce585b5e6322a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:21.445579 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b77daadc6714777a02ce585b5e6322a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:21.452476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b77daadc6714777a02ce585b5e6322a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:21.465927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b77daadc6714777a02ce585b5e6322a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:21.473055 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1279/2549] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:21 2022] DELETE /identity/v3/users/0b77daadc6714777a02ce585b5e6322a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:21.477786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:21.478391 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:21.478670 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:21.498203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:21.499428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:21.566132 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1271/2550] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:21.580869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:21.582328 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:21.643553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d98c9-271c-4d01-90a8-4e5bc17d589b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:21.647414 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:21.648061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:21.648332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:21.648601 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:21.658609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:21.660131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:21.669976 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1280/2551] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:21.954150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:21.955886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:21.971309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20b70b-bd5c-417f-8a71-75989f3f828b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:21.977095 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:21.977884 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:21.978171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:21.978494 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] PATH_INFO: `/v3/projects/e00bab1c59594fa9ba9d17b29e6f0383` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:21.979701 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00bab1c59594fa9ba9d17b29e6f0383)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:21.981652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:22.032039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00bab1c59594fa9ba9d17b29e6f0383', 'request_id': 'req-076e7742-fc9d-4387-9844-5f31b8847a2a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.037988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00bab1c59594fa9ba9d17b29e6f0383', 'request_id': 'req-076e7742-fc9d-4387-9844-5f31b8847a2a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.046016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00bab1c59594fa9ba9d17b29e6f0383', 'request_id': 'req-076e7742-fc9d-4387-9844-5f31b8847a2a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.057615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] The token cache is being invalidate because project e00bab1c59594fa9ba9d17b29e6f0383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:22.057902 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.058530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.060090 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1272/2552] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:21 2022] DELETE /identity/v3/projects/e00bab1c59594fa9ba9d17b29e6f0383 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:22.064519 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:22.075105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807eed-7084-41a6-98f8-590999e16248 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:22.132895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:22.133535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.133809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.134076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] PATH_INFO: `/v3/users/3da5ae6386874f69b8cac2e2f7b687a5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.135348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da5ae6386874f69b8cac2e2f7b687a5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:22.137360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:22.188215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da5ae6386874f69b8cac2e2f7b687a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.188935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da5ae6386874f69b8cac2e2f7b687a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.198828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da5ae6386874f69b8cac2e2f7b687a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.206041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da5ae6386874f69b8cac2e2f7b687a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.208369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:22.222680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-07e12650-d554-4740-9c05-208401ab2e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da5ae6386874f69b8cac2e2f7b687a5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.228830 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1281/2553] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:22 2022] DELETE /identity/v3/users/3da5ae6386874f69b8cac2e2f7b687a5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:22.516850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:22.518465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:22.533404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e7742-fc9d-4387-9844-5f31b8847a2a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:22.557977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:22.605712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:22.607106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.607594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.608123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] PATH_INFO: `/v3/projects/14f691216f6d4647b8a0a3ccacee5118` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.609454 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f691216f6d4647b8a0a3ccacee5118)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:22.612706 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:22.662989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f691216f6d4647b8a0a3ccacee5118', 'request_id': 'req-e9027a4a-5d1b-4927-81c3-e30df38363c0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.669041 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f691216f6d4647b8a0a3ccacee5118', 'request_id': 'req-e9027a4a-5d1b-4927-81c3-e30df38363c0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.676980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f691216f6d4647b8a0a3ccacee5118', 'request_id': 'req-e9027a4a-5d1b-4927-81c3-e30df38363c0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.687928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] The token cache is being invalidate because project 14f691216f6d4647b8a0a3ccacee5118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:22.688427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.689065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e9027a4a-5d1b-4927-81c3-e30df38363c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:22.690577 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1273/2554] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:22 2022] DELETE /identity/v3/projects/14f691216f6d4647b8a0a3ccacee5118 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:22.695561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.696079 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.696174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.715511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:22.716646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:22.776233 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1282/2555] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:22.786900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.787313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.787722 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.812062 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:22.813321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:22.821721 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1274/2556] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:22.826179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:22.836439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f429d-6d43-4621-86c9-173091d27aea None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:22.841289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:22.841893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.842211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.842482 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.843189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:22.843489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:22.845243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:22.857370 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1283/2557] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:22.861849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:22.871150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d738c81-cadb-4750-9bc7-4b1e9156b697 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:22.876704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:22.877295 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.877570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.877859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:22.878503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:22.880422 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:22.912536 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1275/2558] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:22 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:22.919406 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:22.932182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d8e8-8bbb-49d4-9d33-c588d2a6a214 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:22.998253 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:22.998780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:22.999056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:22.999326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.000005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.002233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.030143 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1284/2559] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:22 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:23.035408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.046801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4339e8a-69ac-4255-b812-480f1976b9c0 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.052433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.053039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.053313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.053606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.054258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.055837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.065878 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1276/2560] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:23.070139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.080337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995e17-b3bf-4259-95ad-7ac30abd8b61 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.084867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.085460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.085733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.086000 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.086644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.088287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc132f1-ed17-448c-9529-49526be4a611 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.099753 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1285/2561] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:23.104004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.115129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77192-3e0c-4a57-9ed4-a1de007d08ba admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.120537 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.121223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.121501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.121768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] PATH_INFO: `/v3/projects/33b38ccbe870402cbaef8731bcb19c73/users/4e6f0e2df05c4c4384a1fa84e8572bb7/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.139528 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b38ccbe870402cbaef8731bcb19c73, user_id=4e6f0e2df05c4c4384a1fa84e8572bb7, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.142529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.158207 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1277/2562] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:23 2022] PUT /identity/v3/projects/33b38ccbe870402cbaef8731bcb19c73/users/4e6f0e2df05c4c4384a1fa84e8572bb7/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:23.172685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.172974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.173407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.203894 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] MFA Rules not processed for user `4e6f0e2df05c4c4384a1fa84e8572bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:23.205238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:23.248179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:23.277718 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1286/2563] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:23.283156 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.334420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:23.349683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae17a17-e1de-4f40-9c20-6c646840451f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.356238 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.357239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.357679 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.357958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.358589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.360754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.394765 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1278/2564] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:23 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:23.399032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.410488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea39fe-e2fc-4227-a2f0-e56047557de0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.476284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.476994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.477478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.477731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.478575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.481468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.510923 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1287/2565] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:23 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:23.515204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.526373 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1a5b-7755-47b7-ba4e-1189884c8d80 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.532659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.533193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.533466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.533728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.534364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.536021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.546837 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1279/2566] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:23.551207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.561712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba18928-40f8-4dd4-917d-6e1f7f6777dc admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.566755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.567413 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.567862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.568134 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] PATH_INFO: `/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406/users/93759994d7a7466f844a263f1eccb390/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.583350 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb32a0f3b3a74700a9c4dba3e8aa6406, user_id=93759994d7a7466f844a263f1eccb390, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.586422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.601783 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1288/2567] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:23 2022] PUT /identity/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406/users/93759994d7a7466f844a263f1eccb390/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:23.605732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.617464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b311c2-e85f-4e58-8261-475ac2bcbd76 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.682144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.682760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.683034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.683298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.684070 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.685928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536b77-a4f9-48c8-b854-21ca4bb6a15b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.696023 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1280/2568] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:23.700345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.711919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61bc8-f7e2-4da1-aaea-a8f0c7e31f64 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.716933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.717588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.717859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.718124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] PATH_INFO: `/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406/users/93759994d7a7466f844a263f1eccb390/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.720478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb32a0f3b3a74700a9c4dba3e8aa6406, user_id=93759994d7a7466f844a263f1eccb390, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.723208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.734228 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1289/2569] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:23 2022] PUT /identity/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406/users/93759994d7a7466f844a263f1eccb390/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:23.744739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.745025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.745292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.774678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] MFA Rules not processed for user `93759994d7a7466f844a263f1eccb390`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:23.775957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:23.851502 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1281/2570] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:23.862784 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:23.864549 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:23.924881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836be12-65ae-4dd0-bd24-bfef96013bbf admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:23.928672 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:23.929289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:23.929563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:23.929832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:23.939604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:23.941223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:23.952778 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1290/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:25.112121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:25.113733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:25.126180 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d58d8a-e95b-4fb2-81c3-46654f3611d3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:25.132328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:25.132945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:25.133245 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:25.133516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:25.135274 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:25.182087 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:25.208731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:25.210178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992fac7-4a64-483a-a226-37ee0d4a982b service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:25.221295 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1282/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:25.454468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:25.499917 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:25.544617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d279-e67e-47cb-931f-984a25625937 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:25.550509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:25.551152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:25.551428 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:25.551689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] PATH_INFO: `/v3/users/4e6f0e2df05c4c4384a1fa84e8572bb7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:25.552956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6f0e2df05c4c4384a1fa84e8572bb7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:25.554906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:25.609509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6f0e2df05c4c4384a1fa84e8572bb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:25.610150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6f0e2df05c4c4384a1fa84e8572bb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:25.619025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6f0e2df05c4c4384a1fa84e8572bb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:25.627238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6f0e2df05c4c4384a1fa84e8572bb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:25.639277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6f0e2df05c4c4384a1fa84e8572bb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:25.645957 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1291/2573] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:25 2022] DELETE /identity/v3/users/4e6f0e2df05c4c4384a1fa84e8572bb7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:25.650882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:25.651163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:25.651435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:25.671717 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:25.672946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:25.735254 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1283/2574] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:25.749418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:25.751163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:25.813183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d5e5d-1216-4d26-b5c5-43093c7d5dc8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:25.818206 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:25.818824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:25.819102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:25.819398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:25.829246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:25.830811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:25.840443 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1292/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:26.130308 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:26.132134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:26.153981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc5fb-6da8-432d-aa3a-e1f6c6f1f4de None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:26.160293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:26.160934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:26.161128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:26.161398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] PATH_INFO: `/v3/projects/33b38ccbe870402cbaef8731bcb19c73` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:26.162915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b38ccbe870402cbaef8731bcb19c73)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:26.164858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:26.218568 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b38ccbe870402cbaef8731bcb19c73', 'request_id': 'req-2d70f480-6415-42e4-8dae-4b1b0ea49409'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.225992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b38ccbe870402cbaef8731bcb19c73', 'request_id': 'req-2d70f480-6415-42e4-8dae-4b1b0ea49409'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.234909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b38ccbe870402cbaef8731bcb19c73', 'request_id': 'req-2d70f480-6415-42e4-8dae-4b1b0ea49409'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.247230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] The token cache is being invalidate because project 33b38ccbe870402cbaef8731bcb19c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:26.247718 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.248467 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.249995 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1284/2576] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:26 2022] DELETE /identity/v3/projects/33b38ccbe870402cbaef8731bcb19c73 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:26.255574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:26.265470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61eb8-0771-4e89-ae54-54593ee17fdf service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:26.326404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:26.336001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:26.336760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:26.337409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:26.337757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] PATH_INFO: `/v3/users/93759994d7a7466f844a263f1eccb390` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:26.339245 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93759994d7a7466f844a263f1eccb390)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:26.341379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:26.387457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93759994d7a7466f844a263f1eccb390'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.388177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93759994d7a7466f844a263f1eccb390'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.398119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93759994d7a7466f844a263f1eccb390'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.405810 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93759994d7a7466f844a263f1eccb390'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.419760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9b7f1ad5-3994-466a-9200-6a1113fe2ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93759994d7a7466f844a263f1eccb390'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.426262 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1293/2577] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:26 2022] DELETE /identity/v3/users/93759994d7a7466f844a263f1eccb390 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:26.715026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:26.716657 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:26.730138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f480-6415-42e4-8dae-4b1b0ea49409 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:26.803402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:26.804131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:26.804457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:26.804729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] PATH_INFO: `/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:26.806065 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb32a0f3b3a74700a9c4dba3e8aa6406)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:26.808518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:26.811600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:26.859756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb32a0f3b3a74700a9c4dba3e8aa6406', 'request_id': 'req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.865278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb32a0f3b3a74700a9c4dba3e8aa6406', 'request_id': 'req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.878261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb32a0f3b3a74700a9c4dba3e8aa6406', 'request_id': 'req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.889744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] The token cache is being invalidate because project cb32a0f3b3a74700a9c4dba3e8aa6406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:26.890080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.890642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b1a6d4d-db89-4f4f-a68b-3394b62540a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:26.892182 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1285/2578] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:26 2022] DELETE /identity/v3/projects/cb32a0f3b3a74700a9c4dba3e8aa6406 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:26.897223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:26.897708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:26.897805 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:26.918515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:26.919714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:26.991645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1294/2579] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:27.000040 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.000314 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.000590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.020186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:27.021375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:27.029300 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1286/2580] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:27.034449 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.045551 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed891b-2298-46e2-9081-b44acee8f29a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.051498 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.052166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.052437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.052700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.053346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:27.053708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.055467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.068423 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1295/2581] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:27.073209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.083409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68427232-29b3-4435-8cff-da1fc8e57a20 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.088750 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.089396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.089674 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.089942 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.090572 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.092705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.122734 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1287/2582] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:27.129198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.139400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a295cb-4956-4ba3-90bd-eff580607e22 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.202193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.202895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.203242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.203553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.204256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.206312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.215490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:27.231066 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1296/2583] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:27.235555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.246752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665617bf-c71c-415c-a522-b510be2014dc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.252473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.253110 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.253390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.253677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.254407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.256025 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.266497 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1288/2584] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:27.271078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.282044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91540a8-e94c-4c7e-accd-03d9663c10f7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.287412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.288155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.288488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.288758 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.289405 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.291208 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd525f5-651b-4051-b79d-962d77f4407c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.305153 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1297/2585] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:27.310121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.320751 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553a75-f948-413b-a5cc-8867cc7751a9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.326417 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.327344 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.327654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.327961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] PATH_INFO: `/v3/projects/c6962b6f667043e2a380f292e8416585/users/4b5beeddc74e415e82310c159f57ebcf/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.343760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6962b6f667043e2a380f292e8416585, user_id=4b5beeddc74e415e82310c159f57ebcf, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.346429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.361821 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1289/2586] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:27 2022] PUT /identity/v3/projects/c6962b6f667043e2a380f292e8416585/users/4b5beeddc74e415e82310c159f57ebcf/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:27.372445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.372726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.372979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.400734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] MFA Rules not processed for user `4b5beeddc74e415e82310c159f57ebcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:27.401952 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:27.473362 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1298/2587] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:27.478150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.551310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb1bf-34d9-425c-a425-9f82d5b4c06b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.556893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.557501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.557775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.558047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.558666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.560634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.591079 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1290/2588] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:27.595221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.608938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0341-71c3-4c6d-821d-5863ab038caf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.670155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.670778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.671052 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.671316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.671977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.673987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.696644 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1299/2589] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:27.700656 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.711354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11bdd-fa5b-4323-aaad-9c9b23fe0195 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.716241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.716858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.717135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.717405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.718055 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.719655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.730864 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1291/2590] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:27.735093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.746231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244464ed-c2ad-4ed2-ba50-16c35905c40f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.752042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.752711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.752988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.753254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] PATH_INFO: `/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c/users/9a7f2248f3be4819a62aea3d480cf021/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.770228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14f9ef722ef4ace8bd4186c8d9d449c, user_id=9a7f2248f3be4819a62aea3d480cf021, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.773067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.789644 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1300/2591] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:27 2022] PUT /identity/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c/users/9a7f2248f3be4819a62aea3d480cf021/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:27.793855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.799298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:27.806516 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e542-6a36-4e49-be64-0426f369a08e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.866990 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.867604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.867914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.868190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.868849 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.870439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7a16-3c89-41ca-9cfe-084f03d37e93 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.881461 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1292/2592] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:27.885881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:27.897067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9ed9-5b85-409a-a75e-098daf0eeda0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:27.901617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:27.902304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.902535 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.902806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] PATH_INFO: `/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c/users/9a7f2248f3be4819a62aea3d480cf021/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.904920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14f9ef722ef4ace8bd4186c8d9d449c, user_id=9a7f2248f3be4819a62aea3d480cf021, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:27.908450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:27.919800 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1301/2593] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:27 2022] PUT /identity/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c/users/9a7f2248f3be4819a62aea3d480cf021/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:27.931776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4712-825d-4740-a085-9503e26f979d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:27.932098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4712-825d-4740-a085-9503e26f979d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:27.932383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4712-825d-4740-a085-9503e26f979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:27.963808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1dec4712-825d-4740-a085-9503e26f979d None None] MFA Rules not processed for user `9a7f2248f3be4819a62aea3d480cf021`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:27.964882 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1dec4712-825d-4740-a085-9503e26f979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:28.042328 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1293/2594] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:28.055876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.057711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:28.086381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:28.122298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46e967-0800-4925-9b3e-b8ffc3a47802 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.126060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.126677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.126948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.127215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.138576 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:28.140242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:28.150576 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1302/2595] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:28.495515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec4712-825d-4740-a085-9503e26f979d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.505628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec4712-825d-4740-a085-9503e26f979d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.511039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7f2248f3be4819a62aea3d480cf021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.511654 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.511971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.512240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.512897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:28.513240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:28.514807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:28.530265 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1294/2596] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:28.531813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.541570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668a56-0120-4764-91c0-9c02afe3bdde service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.546184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7f2248f3be4819a62aea3d480cf021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.546898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.547178 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.547501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.548155 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:28.550229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:28.585071 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1303/2597] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:28 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:28.586316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.596912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587c7d-14ac-403b-a04e-6b9860a2ad3c tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.672326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7f2248f3be4819a62aea3d480cf021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.672946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.673228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.673500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.674179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:28.674459 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:28.676535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:28.691352 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1295/2598] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:28.731028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:28.742544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560eec3-7e50-45ce-bb49-951f05bf63c0 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:28.748049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7f2248f3be4819a62aea3d480cf021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:28.748693 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:28.748967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:28.749233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] PATH_INFO: `/v3/projects/764f3731618749488077d72f96507bd3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:28.750418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorizing `identity:delete_project(project_id=764f3731618749488077d72f96507bd3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:28.752440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:28.806780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764f3731618749488077d72f96507bd3', 'request_id': 'req-4360ca93-b437-46a1-bb87-3ebb7fff7819'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:28.812825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764f3731618749488077d72f96507bd3', 'request_id': 'req-4360ca93-b437-46a1-bb87-3ebb7fff7819'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:28.822616 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764f3731618749488077d72f96507bd3', 'request_id': 'req-4360ca93-b437-46a1-bb87-3ebb7fff7819'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:28.844126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] The token cache is being invalidate because project 764f3731618749488077d72f96507bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:28.844890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:28.846212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4360ca93-b437-46a1-bb87-3ebb7fff7819 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:28.854476 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1304/2599] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:28 2022] DELETE /identity/v3/projects/764f3731618749488077d72f96507bd3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:29.238321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:29.241605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:29.257001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:29.350198 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ce756-3300-4f5a-8c84-60bce300e745 tempest-VolumeQuotaClassesTest-444882023 tempest-VolumeQuotaClassesTest-444882023-project-admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:29.426967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:29.427691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:29.428060 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:29.428354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] PATH_INFO: `/v3/users/4b5beeddc74e415e82310c159f57ebcf` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:29.429860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5beeddc74e415e82310c159f57ebcf)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:29.431842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:29.487010 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5beeddc74e415e82310c159f57ebcf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:29.500107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5beeddc74e415e82310c159f57ebcf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:29.508408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5beeddc74e415e82310c159f57ebcf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:29.509019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5beeddc74e415e82310c159f57ebcf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:29.509606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5beeddc74e415e82310c159f57ebcf'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:29.522282 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1296/2600] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:29 2022] DELETE /identity/v3/users/4b5beeddc74e415e82310c159f57ebcf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:29.526864 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:29.527407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:29.527505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:29.547762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:29.548991 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:29.614278 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1305/2601] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:29.628829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:29.630285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:29.670445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:29.705802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d12f4-feba-4715-9ebc-0e2346d6ba81 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:29.710601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:29.711296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:29.711663 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:29.712034 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:29.722864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:29.725000 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:29.736673 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1297/2602] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:30.026172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:30.027322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:30.047478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5542b-7acb-4f83-8ab1-081d7598d5a8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:30.059403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:30.059403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.059403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.059403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] PATH_INFO: `/v3/projects/c6962b6f667043e2a380f292e8416585` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.060475 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6962b6f667043e2a380f292e8416585)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:30.062552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:30.089499 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:30.120333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6962b6f667043e2a380f292e8416585', 'request_id': 'req-4ac25d42-b4b5-4e36-84b6-c1f96136263e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.126545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6962b6f667043e2a380f292e8416585', 'request_id': 'req-4ac25d42-b4b5-4e36-84b6-c1f96136263e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.136502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6962b6f667043e2a380f292e8416585', 'request_id': 'req-4ac25d42-b4b5-4e36-84b6-c1f96136263e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.153285 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] The token cache is being invalidate because project c6962b6f667043e2a380f292e8416585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:30.153660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.154447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.156716 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1306/2603] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:30 2022] DELETE /identity/v3/projects/c6962b6f667043e2a380f292e8416585 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:30.160650 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:30.171146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe604f8-c28d-43c5-8eff-f378a19c01e9 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:30.238531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:30.239354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.239629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.239945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] PATH_INFO: `/v3/users/9a7f2248f3be4819a62aea3d480cf021` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.241195 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7f2248f3be4819a62aea3d480cf021)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:30.243202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:30.321083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:30.322567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:30.324539 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7f2248f3be4819a62aea3d480cf021'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.340222 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7f2248f3be4819a62aea3d480cf021'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.341100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac25d42-b4b5-4e36-84b6-c1f96136263e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:30.348976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:30.349988 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.350492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.351008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] PATH_INFO: `/v3/users/16f4b197022749b0814d180bf4a11c51` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.352337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f4b197022749b0814d180bf4a11c51)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:30.354630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7f2248f3be4819a62aea3d480cf021'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.355346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7f2248f3be4819a62aea3d480cf021'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.355478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:30.356168 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-26918499-2ead-4925-bd49-f14461a723f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7f2248f3be4819a62aea3d480cf021'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.374289 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1298/2604] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:30 2022] DELETE /identity/v3/users/9a7f2248f3be4819a62aea3d480cf021 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:30.416965 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f4b197022749b0814d180bf4a11c51'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.417840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f4b197022749b0814d180bf4a11c51'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.429193 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f4b197022749b0814d180bf4a11c51'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.438040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f4b197022749b0814d180bf4a11c51'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.456005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f4b197022749b0814d180bf4a11c51'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:30.463194 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1307/2605] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:30 2022] DELETE /identity/v3/users/16f4b197022749b0814d180bf4a11c51 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:30.468604 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.469085 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.469425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.493725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:30.495017 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:30.552737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:30.578683 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1299/2606] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:30.580117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:30.581772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:30.647336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24382-58e5-45ca-8a92-eeb64801ed89 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:30.651169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:30.651899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.652234 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.652567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.662485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:30.664122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:30.674043 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1308/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:31.085435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.086864 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.100050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362304d-6fd3-4c7b-a9dd-5f454bb68f79 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.105502 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.106232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.106662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.106934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] PATH_INFO: `/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.108141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14f9ef722ef4ace8bd4186c8d9d449c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.110047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.153479 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.155126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.171207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d9b6-9fad-4035-83b4-0be58bea3b81 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.176753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.177501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.177809 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.178631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] PATH_INFO: `/v3/projects/351325128c384137a55e876832d5eb2e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.179920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] RBAC: Authorizing `identity:delete_project(project_id=351325128c384137a55e876832d5eb2e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.181983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.196875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'request_id': 'req-abba6818-1320-4f76-b4bc-96f16b83c5a3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.204980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'request_id': 'req-abba6818-1320-4f76-b4bc-96f16b83c5a3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.213925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14f9ef722ef4ace8bd4186c8d9d449c', 'request_id': 'req-abba6818-1320-4f76-b4bc-96f16b83c5a3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.219003 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:31.234484 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] The token cache is being invalidate because project e14f9ef722ef4ace8bd4186c8d9d449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:31.234781 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.235576 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-abba6818-1320-4f76-b4bc-96f16b83c5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.237448 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1300/2608] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:31 2022] DELETE /identity/v3/projects/e14f9ef722ef4ace8bd4186c8d9d449c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:31.242383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bad-a354-4b98-a035-745d8cd4c05e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.242720 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bad-a354-4b98-a035-745d8cd4c05e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.243093 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95bad-a354-4b98-a035-745d8cd4c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.252275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351325128c384137a55e876832d5eb2e', 'request_id': 'req-257033fe-a7ac-47a8-8e84-0dca319f334c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.258985 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351325128c384137a55e876832d5eb2e', 'request_id': 'req-257033fe-a7ac-47a8-8e84-0dca319f334c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.269383 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351325128c384137a55e876832d5eb2e', 'request_id': 'req-257033fe-a7ac-47a8-8e84-0dca319f334c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.270400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ecd95bad-a354-4b98-a035-745d8cd4c05e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:31.271865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ecd95bad-a354-4b98-a035-745d8cd4c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.288119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] The token cache is being invalidate because project 351325128c384137a55e876832d5eb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:31.288407 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.289093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.290943 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1309/2609] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:31 2022] DELETE /identity/v3/projects/351325128c384137a55e876832d5eb2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:31.299515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.299515 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.343120 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1301/2610] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:31.345566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.345566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.345825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.364867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257033fe-a7ac-47a8-8e84-0dca319f334c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.369939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:31.370204 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.370851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.371131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.371433 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] PATH_INFO: `/v3/users/53b87cc87bdf4455a2666027374ab226` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.371642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.372697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b87cc87bdf4455a2666027374ab226)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.374753 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.382605 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1302/2611] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:31.386921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.397630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdaf09-e7bf-4646-b4d3-2903cb66e1f2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.406141 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.407469 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.407763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.408050 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.408773 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:31.409098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.411678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.429602 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1303/2612] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:31.431367 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.435125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b87cc87bdf4455a2666027374ab226'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.435977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b87cc87bdf4455a2666027374ab226'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.443476 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf91-4179-41ad-9974-375a585c05c5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.445334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b87cc87bdf4455a2666027374ab226'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.448693 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.449432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.449776 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.450109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.450816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.452779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.453313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b87cc87bdf4455a2666027374ab226'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.466386 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b87cc87bdf4455a2666027374ab226'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.473912 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1310/2613] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:31 2022] DELETE /identity/v3/users/53b87cc87bdf4455a2666027374ab226 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:31.484780 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1304/2614] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:31.488861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.490624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.524539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:31.562851 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0a6f-d600-4c90-b781-214a919cde4c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.623130 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.623837 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.623964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.624238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.624897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.626889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.651513 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1311/2615] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:31.655625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.667920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c60d4-8161-4067-a9db-43dc790ffee7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.672623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.673229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.673501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.673763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.674867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.676556 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.687388 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1305/2616] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:31.691673 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.702337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b8678-bf8f-4cf7-9d0c-28c218c14f5d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.707467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.708107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.708378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.708646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.709275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.710877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.720952 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1312/2617] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:31.725364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.735712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fd9a-7207-4f78-93fc-0e9ecdd2cb30 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.741464 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.742190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.742531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.742859 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] PATH_INFO: `/v3/projects/f96f1eed877249cd993f9937473fd062/users/879c8f2d8d434d77a4e59b2c817f7fd3/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.760441 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96f1eed877249cd993f9937473fd062, user_id=879c8f2d8d434d77a4e59b2c817f7fd3, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.763114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adb6a-261b-4224-b882-2cf0aefb84bc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.772932 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.773892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:31.775275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.780380 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1306/2618] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:31 2022] PUT /identity/v3/projects/f96f1eed877249cd993f9937473fd062/users/879c8f2d8d434d77a4e59b2c817f7fd3/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:31.791807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.792517 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.792790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.798994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d15cb3-af9f-481c-a3e2-11e3359bc811 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.821811 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] MFA Rules not processed for user `879c8f2d8d434d77a4e59b2c817f7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:31.823069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.861766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.862394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.862665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.863070 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] PATH_INFO: `/v3/projects/809ee071517143daa53cf48777b68bf7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.864169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ee071517143daa53cf48777b68bf7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.866081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.891622 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1307/2619] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:31.892754 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.903267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625865d-20e5-4b4d-9b2f-3a6744a5bf7e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.913166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ee071517143daa53cf48777b68bf7', 'request_id': 'req-e9f45f70-6460-4cd5-9848-577e33cb3de7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.916976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:31.919201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ee071517143daa53cf48777b68bf7', 'request_id': 'req-e9f45f70-6460-4cd5-9848-577e33cb3de7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.928081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ee071517143daa53cf48777b68bf7', 'request_id': 'req-e9f45f70-6460-4cd5-9848-577e33cb3de7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.940160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] The token cache is being invalidate because project 809ee071517143daa53cf48777b68bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:31.940525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.941191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e9f45f70-6460-4cd5-9848-577e33cb3de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:31.942827 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1313/2620] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:31 2022] DELETE /identity/v3/projects/809ee071517143daa53cf48777b68bf7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:31.949102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854407-8ec2-4e02-8373-887b47c26acb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.949440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854407-8ec2-4e02-8373-887b47c26acb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.949789 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854407-8ec2-4e02-8373-887b47c26acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.962542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.963204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.963483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.963778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.964411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.966396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.969279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-90854407-8ec2-4e02-8373-887b47c26acb None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:31.970471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-90854407-8ec2-4e02-8373-887b47c26acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.979065 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1314/2621] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:31.987308 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.987574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.988063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.999669 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1308/2622] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:32.004178 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.006056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.010007 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:32.011398 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.073423 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1315/2623] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:32.075298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee70-3145-4d1c-a2df-ef17fc08406f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.077651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.080008 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.080623 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.080896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.081163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.081817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.083785 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.086754 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe11bec-6dff-4068-970a-fd7f88b0ef39 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.091326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.091951 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.092229 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.092862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.093146 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:32.093445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.095119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.108420 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1309/2624] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:32.108797 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1316/2625] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:15:32.109678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.112295 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.116865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:32.121645 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8147dc-24bf-4474-a3bd-961e82a95ffa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.122876 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91d2b-2b1d-4e12-80ee-abf8b181bb7a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.127470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.127630 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.128108 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.128288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.128567 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.128734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.128919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.129277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.129388 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.129946 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.131262 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.131515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.142647 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1310/2626] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:32.147003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.157379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f63acf-455b-4268-bc97-8c6366557634 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.162662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.163316 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.163588 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.167049 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1317/2627] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:32.167211 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] PATH_INFO: `/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd/users/93a0069de04e4ae4a3090068d874ad33/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.167843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.178420 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9c72c09b0347c4a2b3d8196958e8bd, user_id=93a0069de04e4ae4a3090068d874ad33, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.181172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.194085 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1311/2628] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:32 2022] PUT /identity/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd/users/93a0069de04e4ae4a3090068d874ad33/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:32.198020 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.231760 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154673-007e-43c4-932e-b7a8bbdac910 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.263269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c22f3d-d39b-4c37-b858-b0bd3a4a8aaa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.268115 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.268727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.269004 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.269473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.270126 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.271769 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.277533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:32.286436 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1312/2629] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:32.290244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.290843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.293425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.294128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.294128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.294687 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.296704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.305982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb142028-e9f7-49e3-ac45-30cf8e27cc91 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.311049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.311809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.312054 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.312362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] PATH_INFO: `/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd/users/93a0069de04e4ae4a3090068d874ad33/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.314292 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9c72c09b0347c4a2b3d8196958e8bd, user_id=93a0069de04e4ae4a3090068d874ad33, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.317151 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1859ca-f1fa-4565-954e-f228b6616863 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.330713 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1318/2630] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:32.330984 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1313/2631] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:32 2022] PUT /identity/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd/users/93a0069de04e4ae4a3090068d874ad33/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:32.332272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.340570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.340878 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.341515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.344953 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d78691-2c6c-4b17-8a64-b8b1dd9420b0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.370182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] MFA Rules not processed for user `93a0069de04e4ae4a3090068d874ad33`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:32.371905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.425956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.426160 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.426778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.426778 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.427415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.429066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.442474 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1319/2632] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:32.443846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.452462 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1314/2633] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:32.454613 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb87-06c5-4bbb-b806-b68f4caae2e6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.461390 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.462191 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.462883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.463230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.463727 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.463875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.465223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.465468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.481511 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1320/2634] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:32.482931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.498593 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274207-5433-422e-a6e4-a33e0ca93bf0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.505010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.505933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.506270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.507231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] PATH_INFO: `/v3/projects/3f6f19a541f04704926e5b337be32469/users/9af4963de30f4fefb8e10a908ff56b21/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.522731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:32.532713 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6f19a541f04704926e5b337be32469, user_id=9af4963de30f4fefb8e10a908ff56b21, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.535763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234400c-e31e-4917-be15-512bac9f9558 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.547199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9a1f-e50d-479c-a611-9cf5507afec1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.550797 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1321/2635] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:32 2022] PUT /identity/v3/projects/3f6f19a541f04704926e5b337be32469/users/9af4963de30f4fefb8e10a908ff56b21/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:32.563195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.563480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.563772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.591431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] MFA Rules not processed for user `9af4963de30f4fefb8e10a908ff56b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:32.592674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.598296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.598911 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.599184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.599450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.670223 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1322/2636] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:32.670903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.670903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.681534 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.682651 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1315/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:32.683327 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:32.696228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29754690-81cd-4c60-9380-af5dfbf7fdae None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.699869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.700476 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.700744 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.701014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.710001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.711440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5c0ea-a4fe-4cd6-af0d-64aee2eb8366 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.720980 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1323/2638] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:32.824662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:32.892760 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170c7ad-671f-460f-8412-7c42abf14721 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:32.897925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:32.898567 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.898842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.899137 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] PATH_INFO: `/v3/users/879c8f2d8d434d77a4e59b2c817f7fd3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:32.900465 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=879c8f2d8d434d77a4e59b2c817f7fd3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:32.902330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:32.950894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:32.952676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879c8f2d8d434d77a4e59b2c817f7fd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:32.967835 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879c8f2d8d434d77a4e59b2c817f7fd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:32.976175 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879c8f2d8d434d77a4e59b2c817f7fd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:32.977003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879c8f2d8d434d77a4e59b2c817f7fd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:32.977691 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879c8f2d8d434d77a4e59b2c817f7fd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:32.993065 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1316/2639] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:32 2022] DELETE /identity/v3/users/879c8f2d8d434d77a4e59b2c817f7fd3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:32.997625 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:32.997961 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:32.998230 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.018950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:33.020912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:33.032980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:33.092879 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1324/2640] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:33.103546 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:33.105015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:33.164560 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d22b9e-9c3d-4b85-9795-36d89ce89e6a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:33.168615 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:33.169323 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:33.169591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:33.169823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.180500 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:33.181968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:33.192258 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1317/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:33.479891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:33.481400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:33.494823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb10d3-0fd6-4751-bce5-2eebe81cf73a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:33.501331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:33.502012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:33.502318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:33.502595 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] PATH_INFO: `/v3/projects/f96f1eed877249cd993f9937473fd062` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.504063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96f1eed877249cd993f9937473fd062)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:33.506502 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:33.564618 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96f1eed877249cd993f9937473fd062', 'request_id': 'req-cfea84b2-ae99-429c-8056-32c0fdfc7038'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.574594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96f1eed877249cd993f9937473fd062', 'request_id': 'req-cfea84b2-ae99-429c-8056-32c0fdfc7038'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.584117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96f1eed877249cd993f9937473fd062', 'request_id': 'req-cfea84b2-ae99-429c-8056-32c0fdfc7038'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.596938 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] The token cache is being invalidate because project f96f1eed877249cd993f9937473fd062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:33.597287 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.598244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.599778 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1325/2642] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:33 2022] DELETE /identity/v3/projects/f96f1eed877249cd993f9937473fd062 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:33.603998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:33.615590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81081-934b-4757-bf1c-b747b832671c service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:33.666080 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:33.667543 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:33.677969 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:33.678783 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:33.679064 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:33.679336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] PATH_INFO: `/v3/users/93a0069de04e4ae4a3090068d874ad33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.680610 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a0069de04e4ae4a3090068d874ad33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:33.682808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:33.739331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea84b2-ae99-429c-8056-32c0fdfc7038 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:33.743338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:33.744067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:33.744330 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:33.744617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:33.746317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:33.749343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a0069de04e4ae4a3090068d874ad33'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.760845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:33.762426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:33.764219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a0069de04e4ae4a3090068d874ad33'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.769744 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:33.774327 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1326/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:33.774671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a0069de04e4ae4a3090068d874ad33'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.775524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a0069de04e4ae4a3090068d874ad33'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.776831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1456d005-8b8d-46c3-8440-125b6e6e59f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a0069de04e4ae4a3090068d874ad33'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:33.792900 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1318/2644] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:33 2022] DELETE /identity/v3/users/93a0069de04e4ae4a3090068d874ad33 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:34.095929 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.097468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.124220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f4b-f74e-4966-b252-ea6b29f3e7d3 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.170223 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:34.202409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.207064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.207064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.207064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] PATH_INFO: `/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.217721 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9c72c09b0347c4a2b3d8196958e8bd)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.225337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.279562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9c72c09b0347c4a2b3d8196958e8bd', 'request_id': 'req-d660c136-8d90-4d0a-bdf9-08a49749d5b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.286846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9c72c09b0347c4a2b3d8196958e8bd', 'request_id': 'req-d660c136-8d90-4d0a-bdf9-08a49749d5b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.303171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9c72c09b0347c4a2b3d8196958e8bd', 'request_id': 'req-d660c136-8d90-4d0a-bdf9-08a49749d5b1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.318881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] The token cache is being invalidate because project 9d9c72c09b0347c4a2b3d8196958e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:34.319177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.319897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d660c136-8d90-4d0a-bdf9-08a49749d5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:34.323926 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1327/2645] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:34 2022] DELETE /identity/v3/projects/9d9c72c09b0347c4a2b3d8196958e8bd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:34.326732 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.327021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.327293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.348906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:34.350182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.431785 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1319/2646] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:34.435234 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.435529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.436112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.457436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:34.458561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.470602 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1328/2647] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:34.475119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.484872 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa0b9-7872-4d52-af05-33038ba311ca None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.490145 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.490823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.491097 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.491487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.492177 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:34.492471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.494077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.509351 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1320/2648] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:34.514009 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.529637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafea07-ee2b-4526-9751-29e4c5ad6cde None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.535437 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.535888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.536275 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.536606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.537708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.539304 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.579110 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1329/2649] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:34.583682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.598166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841f26-6a08-4d2c-8f4e-191b6e53e2b9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.674374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.675067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.675606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.675982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.676787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.682892 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.719501 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1321/2650] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:34.721039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.730071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.731953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.740569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a0932-e5e0-4cd1-b33f-1d3b5d62e4b8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.756247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.756955 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.757779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.758569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.760511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.764085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.785465 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1330/2651] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:34.789278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.806115 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df46a8-721f-4b8f-8284-a91e83e7f2c2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.813108 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.814212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.816404 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.817011 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.818261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.820487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.838452 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1331/2652] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:34.840046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:34.856661 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fa1c-7be7-47f8-8dfb-5e37ba75ce6d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.866129 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.868480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.869893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.870501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] PATH_INFO: `/v3/projects/4e264dd743564c5aacef4461d3fd6d25/users/e05367276ae6429d9c5103b913bd64b0/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.895213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:34.904061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e264dd743564c5aacef4461d3fd6d25, user_id=e05367276ae6429d9c5103b913bd64b0, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.910385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcf4ee-0fdd-4bd8-866b-2b34fd266bce admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.912708 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92ea72-f99b-4ae8-a14d-7c91eb00bce6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:34.920457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:34.921227 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.921596 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.921956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.924360 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:34.930169 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1332/2653] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:34 2022] PUT /identity/v3/projects/4e264dd743564c5aacef4461d3fd6d25/users/e05367276ae6429d9c5103b913bd64b0/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:34.940275 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:34.941996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:34.942284 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:34.942563 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:34.942677 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:34.955357 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1322/2654] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:34.989642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] MFA Rules not processed for user `e05367276ae6429d9c5103b913bd64b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:34.991456 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.101904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:35.130071 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1333/2655] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:35.134908 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.146199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b958-fcbb-429f-a177-82cc8cf753be service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.216351 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.216992 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.217269 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.217538 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.218183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.220349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.253095 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1323/2656] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:35 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:35.257401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.268813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb296-2f14-4bfa-8864-82c31390332b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.340895 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.341994 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.342504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.342779 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.343772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.345394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.370035 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1334/2657] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:35 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:35.374007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.384749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e573-cd88-467b-8010-49fc59d1b1d8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.390082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.390661 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.390960 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.391231 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.391890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.393536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.404953 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1324/2658] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:35.409786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.420349 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718d5a-6087-4981-b09b-544e4879a9f9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.425415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.427221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.427484 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.427862 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] PATH_INFO: `/v3/projects/c27b2fe752074e949fde455f8756b0d2/users/2d2efc91b5074674a80330580840cc12/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.445147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27b2fe752074e949fde455f8756b0d2, user_id=2d2efc91b5074674a80330580840cc12, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.448667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.465728 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1335/2659] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:35 2022] PUT /identity/v3/projects/c27b2fe752074e949fde455f8756b0d2/users/2d2efc91b5074674a80330580840cc12/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:35.469825 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.480374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0e39-bdbb-4e98-8fbb-effa8a652cf1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.547272 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.547938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.548268 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.548590 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.549246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.551278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7801-cebb-48d4-93b0-01db5ad087de admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.566617 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1325/2660] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:35.568116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.581545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fc6d3-e3c3-4959-893a-62ec4fd9404e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.597197 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.598272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.599361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.599523 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] PATH_INFO: `/v3/projects/c27b2fe752074e949fde455f8756b0d2/users/2d2efc91b5074674a80330580840cc12/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.605154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27b2fe752074e949fde455f8756b0d2, user_id=2d2efc91b5074674a80330580840cc12, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.610981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.629725 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1336/2661] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:35 2022] PUT /identity/v3/projects/c27b2fe752074e949fde455f8756b0d2/users/2d2efc91b5074674a80330580840cc12/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:35.720929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.721483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.721483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.757524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] MFA Rules not processed for user `2d2efc91b5074674a80330580840cc12`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:35.758768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.824019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:35.856086 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1326/2662] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:35.868526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:35.870403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:35.944340 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cecf-a68f-4cb6-93bf-6f0e8694712a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:35.949378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:35.950575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:35.950858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:35.951128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:35.966439 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:35.968569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:35.980298 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1337/2663] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:36.082775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.092978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348238c-ace5-4ba5-a881-41faeefcc61f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.098011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.098550 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.098989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.099281 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.120348 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.121867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.182163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:36.196664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.199091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826861-50bd-457b-af54-45d6c4536112 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.212341 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1327/2664] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:36.228516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261d4b-83c8-43f8-bc17-d32549f1a3cf service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.236063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.236945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.237294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.238084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] PATH_INFO: `/v3/users/9af4963de30f4fefb8e10a908ff56b21` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.239442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af4963de30f4fefb8e10a908ff56b21)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.241683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.344814 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af4963de30f4fefb8e10a908ff56b21'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.346171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af4963de30f4fefb8e10a908ff56b21'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.362984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af4963de30f4fefb8e10a908ff56b21'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.371838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af4963de30f4fefb8e10a908ff56b21'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.401293 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af4963de30f4fefb8e10a908ff56b21'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:36.415285 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1338/2665] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:36 2022] DELETE /identity/v3/users/9af4963de30f4fefb8e10a908ff56b21 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:36.419875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.420224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.420569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.454324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:36.458685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.574643 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1328/2666] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:36.591303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:36.594619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:36.744139 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33db0-adc6-4d3a-9efc-d9b2b27823de admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:36.756550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:36.757266 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:36.757840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:36.757840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:36.775533 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:36.777095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f456f9-01bb-494b-a10a-f5c1da2cf942 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:36.798535 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1339/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:37.402700 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.405328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.429926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66615e-79ef-4167-8004-4dbdbc402e1c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.436278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.437003 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.437345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.437678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] PATH_INFO: `/v3/projects/3f6f19a541f04704926e5b337be32469` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.439023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6f19a541f04704926e5b337be32469)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.441240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.494563 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6f19a541f04704926e5b337be32469', 'request_id': 'req-197a5df4-a327-4562-9d83-7ce40cacd32b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.500310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6f19a541f04704926e5b337be32469', 'request_id': 'req-197a5df4-a327-4562-9d83-7ce40cacd32b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.508685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6f19a541f04704926e5b337be32469', 'request_id': 'req-197a5df4-a327-4562-9d83-7ce40cacd32b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.522967 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] The token cache is being invalidate because project 3f6f19a541f04704926e5b337be32469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:37.523260 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.523926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-197a5df4-a327-4562-9d83-7ce40cacd32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.525463 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1329/2668] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:37 2022] DELETE /identity/v3/projects/3f6f19a541f04704926e5b337be32469 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:37.530443 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.530943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.531030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.578762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:37.585092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.709115 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1340/2669] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:37.717014 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.717324 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.717621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.726753 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:37.755104 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:37.757726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.779775 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1330/2670] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:37.784826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.802714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:37.825254 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44fd42-63c7-427e-988c-18dd53ac313a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.833235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.834033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.842487 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.843095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.844203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:37.844815 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.846823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.873420 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1341/2671] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:37.878246 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.888678 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ff56-7807-4548-8f30-385735f0ec6e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.898425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.899298 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.899822 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.900505 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.901928 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.905577 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.980488 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1331/2672] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:37.984797 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.998046 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a808-694d-496e-9a0f-7fb035d263ee admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.105750 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.106566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.107004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.107468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.108326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.110874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.145561 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1342/2673] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:38.147043 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.171461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5940-e104-4a5a-b20e-3ff58f1fc908 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.200741 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.201402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.201605 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.201886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.202529 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.204277 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.220739 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1332/2674] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:38.225544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.242691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a21900-f643-415a-b32d-4f9a387eb411 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.252651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.253397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.254248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.254248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.254823 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.256513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa5c44-7fd1-487c-bedd-3aff1ac63c7f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.287262 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1343/2675] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:38.292487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.309916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d479e8-2ebc-4910-809a-ab415202b0d4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.322140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.322140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.322140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.322140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] PATH_INFO: `/v3/projects/fdb8ffa7611f42fdbe7615c86a980fa6/users/e326b2750f604509aa2375a7a42d8f7f/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.354428 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8ffa7611f42fdbe7615c86a980fa6, user_id=e326b2750f604509aa2375a7a42d8f7f, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.357796 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.391277 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1333/2676] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:38 2022] PUT /identity/v3/projects/fdb8ffa7611f42fdbe7615c86a980fa6/users/e326b2750f604509aa2375a7a42d8f7f/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:38.402117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.402472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.402705 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.442808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] MFA Rules not processed for user `e326b2750f604509aa2375a7a42d8f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:38.444421 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:38.527770 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1344/2677] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:38.541512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.543330 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:38.633075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df63af5-ac48-4664-ac3e-a5969aafd34a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.638798 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.639511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.639994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.640146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.657044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.658159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.668675 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1334/2678] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:38.686341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.689005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:38.776833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f488c5-03f7-443f-a6ec-6fc27613a01a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.782474 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.783326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.783846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.784324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] PATH_INFO: `/v3/users/46af30b9e2ab484f81b83e21555e8aa5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.785614 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46af30b9e2ab484f81b83e21555e8aa5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.787587 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.789382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:38.845651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46af30b9e2ab484f81b83e21555e8aa5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.846424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46af30b9e2ab484f81b83e21555e8aa5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.856640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46af30b9e2ab484f81b83e21555e8aa5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.868850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46af30b9e2ab484f81b83e21555e8aa5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.885195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46af30b9e2ab484f81b83e21555e8aa5'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.894113 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1345/2679] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:38 2022] DELETE /identity/v3/users/46af30b9e2ab484f81b83e21555e8aa5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:39.009209 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.011642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.138893 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.140596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.233558 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d15e2-8e1f-4952-9ccc-6c53dde7efd4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.238316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.239116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.240012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.240620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] PATH_INFO: `/v3/projects/c32ea6d5e4e74d7e9c2729691f23fe9f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.241495 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32ea6d5e4e74d7e9c2729691f23fe9f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.243530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.272381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92aec-ef49-4518-b215-caed447b262b service glance] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.313993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32ea6d5e4e74d7e9c2729691f23fe9f', 'request_id': 'req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.319968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32ea6d5e4e74d7e9c2729691f23fe9f', 'request_id': 'req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.328282 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32ea6d5e4e74d7e9c2729691f23fe9f', 'request_id': 'req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.331713 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.332435 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.332780 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.333114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.335064 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.340181 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] The token cache is being invalidate because project c32ea6d5e4e74d7e9c2729691f23fe9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:39.340471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.341169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7f0c5fe0-ab35-4d4e-88f6-b989a7039fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:39.342824 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1346/2680] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:39 2022] DELETE /identity/v3/projects/c32ea6d5e4e74d7e9c2729691f23fe9f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:39.347092 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.347816 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.348105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.348375 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.349196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b0c04-5874-4dce-ba46-f1111efccedb service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.359385 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1335/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:39.370960 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:39.372195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.376964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:39.455789 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1347/2682] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:39.463523 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.464038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.464871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.480410 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:39.507925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:39.510890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:39.521075 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1336/2683] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:39.526976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.540215 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88860cd4-30b6-4a0a-be40-e141bb7fac5d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.546604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.547225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.547765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.548047 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.548804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:39.549105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.551574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.566912 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1348/2684] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:39.570815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.580865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f6061-77c1-47ce-8aee-f7519305ed3a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.587599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.588321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.588594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.588865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.589492 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.591386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.643586 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1337/2685] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:39 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:39.650116 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.663733 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21935ab1-b64b-4898-9e19-f49d623caad3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.753332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.755890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.755890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.755890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.755890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.757462 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.806227 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1349/2686] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:39 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:39.811585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.831411 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3539b23-be33-4e9c-a0a0-f847ab5f71c4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.839165 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.840266 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.840702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.841149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.842166 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.844566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.866884 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1338/2687] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:39.871470 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.886859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bd5b-3f9b-4048-8896-661e8fa5941c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.892903 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.894819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.895219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.895532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.896300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.898216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4822bff-9d02-475b-b129-205a1e756055 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.917645 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1350/2688] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:39.923698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:39.939213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791173cc-25a0-4b32-bfb2-c72e68eb26a3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:39.947179 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:39.948415 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:39.948839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:39.950066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] PATH_INFO: `/v3/projects/e1b2a73d0a0f4232a7b036a2cf79532e/users/610b82ad107c4f50840b0f39cb723e49/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:39.968311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b2a73d0a0f4232a7b036a2cf79532e, user_id=610b82ad107c4f50840b0f39cb723e49, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:39.971012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:39.994278 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1339/2689] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:39 2022] PUT /identity/v3/projects/e1b2a73d0a0f4232a7b036a2cf79532e/users/610b82ad107c4f50840b0f39cb723e49/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:40.010094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.010389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.010642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.054906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] MFA Rules not processed for user `610b82ad107c4f50840b0f39cb723e49`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:40.056509 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:40.174052 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1351/2690] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:40.179431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.309846 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522c3d-ded6-41e4-8c33-928cb0ae7220 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.327624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.328445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.328723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.328985 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.330088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.332078 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.376068 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1340/2691] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/projects => generated 393 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:40.387095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.388566 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:40.393936 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402660d2-9e43-4558-93a8-426a184d4941 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.486166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.486972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.487250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.487574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.488620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.490529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.522982 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1352/2692] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:40.527148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.544972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafad2a-0516-4dc9-9f2b-d33216d2da14 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.550685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.551291 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.551382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.551651 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.552592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.554554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.572244 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1341/2693] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:40.574226 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.596659 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976bad-bc6d-4c44-af3e-3c12ac763359 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.598840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.599728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.600105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.600377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] PATH_INFO: `/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb/users/a068217c4e0a46e889019c3a4d0e3ae4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.636420 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbe403ea0fd4b1b82eb4a36721edeeb, user_id=a068217c4e0a46e889019c3a4d0e3ae4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.640221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.671641 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1353/2694] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:40 2022] PUT /identity/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb/users/a068217c4e0a46e889019c3a4d0e3ae4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:40.673278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.687853 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0a107-3ec2-4bcb-9c10-4fc705f067c6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.795321 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.796011 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.796290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.796559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.797219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.798860 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029edc86-cfd2-4685-94d3-83463166e571 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.812187 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1342/2695] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:40.817397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:40.832078 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05a79-cf16-4a1e-844b-ae806e04953f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:40.840087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:40.841128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.841483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.841846 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] PATH_INFO: `/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb/users/a068217c4e0a46e889019c3a4d0e3ae4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.844016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbe403ea0fd4b1b82eb4a36721edeeb, user_id=a068217c4e0a46e889019c3a4d0e3ae4, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:40.847270 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:40.862907 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1354/2696] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:40 2022] PUT /identity/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb/users/a068217c4e0a46e889019c3a4d0e3ae4/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:40.876049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:40.876296 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:40.876527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:40.905770 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:40.917408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] MFA Rules not processed for user `a068217c4e0a46e889019c3a4d0e3ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:40.918867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:40.993119 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1343/2697] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:41.004182 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:41.009739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:41.078817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb095b-5d49-4bb0-9759-6d62c9ac2c9c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:41.083097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:41.083711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:41.084017 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:41.084264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:41.095242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:41.097072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:41.107484 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1355/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:41.178481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:41.180974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:41.196895 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a701-e275-404d-8764-8fca1caf0c8e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:41.200573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:41.201196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:41.201475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:41.201739 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:41.277520 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:41.278964 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca441b-742a-43f6-a2bc-477f59e374a5 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:41.289773 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1344/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:42.001855 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:42.003873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:42.082729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba32d-08eb-46d8-9e49-86ae35f5d02b service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:42.087041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:42.087671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:42.087977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:42.088248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] PATH_INFO: `/v3/users/e05367276ae6429d9c5103b913bd64b0` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:42.089379 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05367276ae6429d9c5103b913bd64b0)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:42.091321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:42.092897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:42.144225 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05367276ae6429d9c5103b913bd64b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:42.144945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05367276ae6429d9c5103b913bd64b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:42.154203 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05367276ae6429d9c5103b913bd64b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:42.163827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05367276ae6429d9c5103b913bd64b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:42.176914 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05367276ae6429d9c5103b913bd64b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:42.190764 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1356/2700] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:42 2022] DELETE /identity/v3/users/e05367276ae6429d9c5103b913bd64b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:42.195638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808527e-9f32-49b5-b064-802d906df17c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:42.196207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808527e-9f32-49b5-b064-802d906df17c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:42.196207 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808527e-9f32-49b5-b064-802d906df17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:42.216676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3808527e-9f32-49b5-b064-802d906df17c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:42.218101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3808527e-9f32-49b5-b064-802d906df17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:42.298931 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1345/2701] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:42.314153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:42.315728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:42.400485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad352-38f4-4bb3-8afe-69439b2907cb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:42.405431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:42.405431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:42.405431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:42.405877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:42.427516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:42.429652 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:42.440632 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1357/2702] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:43.350594 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808527e-9f32-49b5-b064-802d906df17c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:43.352188 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3808527e-9f32-49b5-b064-802d906df17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:43.369094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808527e-9f32-49b5-b064-802d906df17c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:43.382684 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:43.383808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:43.385354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:43.385807 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] PATH_INFO: `/v3/projects/4e264dd743564c5aacef4461d3fd6d25` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:43.387350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e264dd743564c5aacef4461d3fd6d25)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:43.389815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:43.453069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:43.477918 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e264dd743564c5aacef4461d3fd6d25', 'request_id': 'req-49429a79-0181-4bd2-a880-086a5b062bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.500522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e264dd743564c5aacef4461d3fd6d25', 'request_id': 'req-49429a79-0181-4bd2-a880-086a5b062bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.520843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e264dd743564c5aacef4461d3fd6d25', 'request_id': 'req-49429a79-0181-4bd2-a880-086a5b062bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.557119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] The token cache is being invalidate because project 4e264dd743564c5aacef4461d3fd6d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:43.557280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.557957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.560140 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1346/2703] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:43 2022] DELETE /identity/v3/projects/4e264dd743564c5aacef4461d3fd6d25 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:43.563999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:43.575412 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cf0fc-2fa0-48b2-ab9a-6f3cbc801906 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:43.651638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:43.654708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:43.654708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:43.654708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] PATH_INFO: `/v3/users/2d2efc91b5074674a80330580840cc12` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:43.655152 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2efc91b5074674a80330580840cc12)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:43.657840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:43.691450 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:43.720244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2efc91b5074674a80330580840cc12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.722086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2efc91b5074674a80330580840cc12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.736148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2efc91b5074674a80330580840cc12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.747869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2efc91b5074674a80330580840cc12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.776346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-175e54db-baee-4c6c-9719-5105f2d0d5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2efc91b5074674a80330580840cc12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:43.791786 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1358/2704] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:43 2022] DELETE /identity/v3/users/2d2efc91b5074674a80330580840cc12 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:44.428622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:44.430267 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:44.445016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429a79-0181-4bd2-a880-086a5b062bc7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:44.516338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:44.517326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.517603 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.517894 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] PATH_INFO: `/v3/projects/c27b2fe752074e949fde455f8756b0d2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.519127 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27b2fe752074e949fde455f8756b0d2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:44.521240 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:44.577929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27b2fe752074e949fde455f8756b0d2', 'request_id': 'req-3e7fdaec-62c2-403b-8518-76e88faec45e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:44.585037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27b2fe752074e949fde455f8756b0d2', 'request_id': 'req-3e7fdaec-62c2-403b-8518-76e88faec45e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:44.599448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27b2fe752074e949fde455f8756b0d2', 'request_id': 'req-3e7fdaec-62c2-403b-8518-76e88faec45e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:44.615430 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] The token cache is being invalidate because project c27b2fe752074e949fde455f8756b0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:44.615842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:44.616585 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3e7fdaec-62c2-403b-8518-76e88faec45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:44.619108 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1347/2705] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:44 2022] DELETE /identity/v3/projects/c27b2fe752074e949fde455f8756b0d2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:44.624355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.625325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.625666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.648582 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:44.649959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:44.724083 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1359/2706] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:44.731865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.732144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.732407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.753601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:44.757012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:44.765171 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1348/2707] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:44.769746 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:44.779415 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f072d-3162-4ee2-8a23-d008bb2698d3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:44.784681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:44.785289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.785565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.785833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.786480 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:44.786835 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:44.788506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:44.800103 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1360/2708] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:44.804644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:44.814290 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ea8d0-f28a-48a4-ac00-b6f0f0934eb7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:44.819155 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:44.819803 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.820075 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.820338 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.820971 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:44.822842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:44.858401 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1349/2709] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:44 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:44.862964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:44.874756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4b3f-340f-45e3-8f33-e8b130f664d9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:44.942314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:44.943248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:44.943681 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:44.944256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:44.945198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:44.947209 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:44.986967 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1361/2710] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:44 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:44.991444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.009293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064d55-c723-4b20-a337-4542aaa91a25 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.016788 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.017919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.018458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.019437 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.021071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.024257 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.043631 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1350/2711] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:45.046461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.062334 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4f319-be20-4f54-afa3-19c15dfc72a6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.068644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.069556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.075935 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.076651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.077312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.079619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.097905 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1362/2712] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:45.101804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.115779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c3b6-85d9-43f2-ab02-b12dda268195 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.121032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.121763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.122035 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.122332 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] PATH_INFO: `/v3/projects/7d06bfa912bc4d688bc330e6249385fc/users/0eca5a6708cb4e5199f311d872cd489e/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.124851 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:45.135401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.137065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:45.142186 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d06bfa912bc4d688bc330e6249385fc, user_id=0eca5a6708cb4e5199f311d872cd489e, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.145032 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c27c18-dd44-4a84-8eab-711b044dbfa9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.154585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e83-1bc7-4343-a502-40bad2eb9ae3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.168353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.170289 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.170748 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.171187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] PATH_INFO: `/v3/users/610b82ad107c4f50840b0f39cb723e49` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.173055 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] RBAC: Authorizing `identity:delete_user(user_id=610b82ad107c4f50840b0f39cb723e49)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.175631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.177716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:45.183322 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1351/2713] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:45 2022] PUT /identity/v3/projects/7d06bfa912bc4d688bc330e6249385fc/users/0eca5a6708cb4e5199f311d872cd489e/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:45.185848 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.186131 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.186541 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.225346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] MFA Rules not processed for user `0eca5a6708cb4e5199f311d872cd489e`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:45.226642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:45.250075 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610b82ad107c4f50840b0f39cb723e49'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:45.250727 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610b82ad107c4f50840b0f39cb723e49'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:45.264697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610b82ad107c4f50840b0f39cb723e49'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:45.273578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610b82ad107c4f50840b0f39cb723e49'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:45.292488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26fc2db1-3cef-4358-8584-b037417c900e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610b82ad107c4f50840b0f39cb723e49'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:45.299421 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1363/2714] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:45 2022] DELETE /identity/v3/users/610b82ad107c4f50840b0f39cb723e49 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:45.304313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.304717 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.305337 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.309045 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1352/2715] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:45.322406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.323968 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:45.334459 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:45.335714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:45.391120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f81ab7-66dd-4aa6-ade8-285c40e15383 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.403492 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1364/2716] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:45.413119 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:45.416027 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:45.459219 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.459897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.460354 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.460648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.481242 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96e364-df0c-4c33-abcb-11c3c37c5990 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:45.485776 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:45.486696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:45.486972 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:45.487235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:45.498604 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.500107 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.514972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:45.516976 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1365/2717] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:45.530858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:45.532642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:45.541781 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1353/2718] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:46.405422 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:46.407524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:46.433101 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ff42d-f7b9-4c99-a0c1-eaf37fff5992 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:46.438943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:46.439599 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:46.439923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:46.440670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] PATH_INFO: `/v3/projects/e1b2a73d0a0f4232a7b036a2cf79532e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:46.441844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b2a73d0a0f4232a7b036a2cf79532e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:46.443817 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:46.464606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:46.503102 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b2a73d0a0f4232a7b036a2cf79532e', 'request_id': 'req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.508987 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b2a73d0a0f4232a7b036a2cf79532e', 'request_id': 'req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.516979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b2a73d0a0f4232a7b036a2cf79532e', 'request_id': 'req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.529488 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] The token cache is being invalidate because project e1b2a73d0a0f4232a7b036a2cf79532e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:46.529785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.531489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.538876 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1366/2719] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:46 2022] DELETE /identity/v3/projects/e1b2a73d0a0f4232a7b036a2cf79532e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:46.542901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:46.553975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b394-85cd-4069-b03c-6759634ee1f4 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:46.613511 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:46.614135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:46.614408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:46.614672 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] PATH_INFO: `/v3/users/a068217c4e0a46e889019c3a4d0e3ae4` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:46.615816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a068217c4e0a46e889019c3a4d0e3ae4)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:46.617728 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:46.681723 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a068217c4e0a46e889019c3a4d0e3ae4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.693839 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a068217c4e0a46e889019c3a4d0e3ae4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.702365 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a068217c4e0a46e889019c3a4d0e3ae4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.702997 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a068217c4e0a46e889019c3a4d0e3ae4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.703649 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4e975e0a-b897-4e9a-9934-f585ef876185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a068217c4e0a46e889019c3a4d0e3ae4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:46.719570 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1354/2720] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:46 2022] DELETE /identity/v3/users/a068217c4e0a46e889019c3a4d0e3ae4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:47.193085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.197180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:47.213179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245f8-b62f-435b-bfcd-b4f93de6de0f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.340808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.341445 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.341828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.342157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] PATH_INFO: `/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.343345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbe403ea0fd4b1b82eb4a36721edeeb)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.345438 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.398667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbe403ea0fd4b1b82eb4a36721edeeb', 'request_id': 'req-4c27cf45-17a8-481c-b0aa-b2088dea12d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:47.410843 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbe403ea0fd4b1b82eb4a36721edeeb', 'request_id': 'req-4c27cf45-17a8-481c-b0aa-b2088dea12d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:47.421465 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbe403ea0fd4b1b82eb4a36721edeeb', 'request_id': 'req-4c27cf45-17a8-481c-b0aa-b2088dea12d1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:47.436550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] The token cache is being invalidate because project 0dbe403ea0fd4b1b82eb4a36721edeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:47.436854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:47.437531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4c27cf45-17a8-481c-b0aa-b2088dea12d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:47.439436 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1367/2721] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:47 2022] DELETE /identity/v3/projects/0dbe403ea0fd4b1b82eb4a36721edeeb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:47.444926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.445212 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.445472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.469926 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:47.471253 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:47.549808 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1355/2722] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:47.559771 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.560385 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.561084 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.592431 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:47.593633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:47.612621 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1368/2723] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:47.614203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.620408 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:47.625981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569b888-b217-4179-bc3e-0509d342a165 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.634232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.635444 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.635948 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.636382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.637230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:15:47.638285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.642138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.666516 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1356/2724] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:15:47.668099 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.679065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9e552-2fa6-427e-938a-13d4a9e0c079 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.683979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.685222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.685222 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.685762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.686757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.690025 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.734432 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1369/2725] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:47 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:47.743311 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.759082 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b47c-e92b-4f59-903a-ac4653dad970 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.855349 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.856483 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.856912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.857495 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.858285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.861123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.889872 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1357/2726] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:47 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:47.895573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.909355 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89da7b-bc00-4d8d-b486-6af16d69dbb1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.917778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.919490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:47.921923 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.922635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.922968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.923320 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.924081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.926220 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.930346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:47.933586 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38a1f1-1bfe-4196-8318-c69a33ca4b0f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.939333 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.940102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.940552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.941512 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] PATH_INFO: `/v3/users/2eae4549c0684372af1e4fa3d68fe529` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.942815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eae4549c0684372af1e4fa3d68fe529)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.944921 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.946735 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1370/2727] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:47.950585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:47.961332 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330fec-003d-4c08-84c2-39b32103855f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:47.966013 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:47.966606 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:47.966879 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:47.967148 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:47.967859 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:47.969461 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:47.986629 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1371/2728] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:47.989806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:48.000288 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bb3-91fe-4587-a64a-e8482d8c6b32 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:48.005392 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:48.006044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eae4549c0684372af1e4fa3d68fe529'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.006172 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.006369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.006646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] PATH_INFO: `/v3/projects/adda3c0004104bb0aeb0c2440285574f/users/edb2fa38e97a42f0860ef05502ea3edf/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.018018 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eae4549c0684372af1e4fa3d68fe529'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.021836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] RBAC: Authorizing `identity:create_grant(project_id=adda3c0004104bb0aeb0c2440285574f, user_id=edb2fa38e97a42f0860ef05502ea3edf, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:48.024832 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e84a5-323d-4991-8a34-3127acd491da admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:48.027386 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eae4549c0684372af1e4fa3d68fe529'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.028069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eae4549c0684372af1e4fa3d68fe529'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.028695 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eae4549c0684372af1e4fa3d68fe529'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.038789 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1372/2729] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:47 2022] PUT /identity/v3/projects/adda3c0004104bb0aeb0c2440285574f/users/edb2fa38e97a42f0860ef05502ea3edf/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:48.045053 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.045679 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.046098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.052599 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1358/2730] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:47 2022] DELETE /identity/v3/users/2eae4549c0684372af1e4fa3d68fe529 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:48.067869 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:48.069097 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:48.142913 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1373/2731] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:15:48.153377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:48.155413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:48.227613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247cbbc-88e6-4f5d-bf08-f14f340e2ee5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:48.231635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:48.232555 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.233247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.233247 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.241436 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:48.247515 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:48.249524 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:48.261426 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1359/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:48.298644 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:48.300093 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:48.326466 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ab81-5727-4cc6-bbc6-10cd83329771 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:48.331904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:48.332538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.332819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.333098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] PATH_INFO: `/v3/projects/32e99155532848e7a1de0895210c841d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.334298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e99155532848e7a1de0895210c841d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:48.336463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:48.413694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e99155532848e7a1de0895210c841d', 'request_id': 'req-a76d760b-8a2e-47bb-b040-459d32ebb594'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.432246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e99155532848e7a1de0895210c841d', 'request_id': 'req-a76d760b-8a2e-47bb-b040-459d32ebb594'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.446156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e99155532848e7a1de0895210c841d', 'request_id': 'req-a76d760b-8a2e-47bb-b040-459d32ebb594'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.461620 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] The token cache is being invalidate because project 32e99155532848e7a1de0895210c841d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:48.462391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.463219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.465236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1374/2733] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:48 2022] DELETE /identity/v3/projects/32e99155532848e7a1de0895210c841d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:48.469139 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:48.480569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592bc-9f2c-42a4-8987-c7cc1be8538f service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:48.584102 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:48.584865 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.585218 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.585522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] PATH_INFO: `/v3/users/f502d27c3e994141bed8fd464f598e83` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.586834 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f502d27c3e994141bed8fd464f598e83)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:48.588850 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:48.638559 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f502d27c3e994141bed8fd464f598e83'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.650857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f502d27c3e994141bed8fd464f598e83'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.661460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f502d27c3e994141bed8fd464f598e83'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.662120 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f502d27c3e994141bed8fd464f598e83'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.663021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-1ab86bba-5b5d-4390-aed1-301e217dd9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f502d27c3e994141bed8fd464f598e83'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:48.685547 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1360/2734] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:48 2022] DELETE /identity/v3/users/f502d27c3e994141bed8fd464f598e83 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:48.885478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:48.886867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:48.903321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d760b-8a2e-47bb-b040-459d32ebb594 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:48.957944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:48.976757 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:48.977902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:48.978177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:48.978447 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] PATH_INFO: `/v3/projects/6af3023818cc4d1b8d2924b7f3294c01` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:48.979581 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af3023818cc4d1b8d2924b7f3294c01)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:48.981694 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.042030 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.042274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af3023818cc4d1b8d2924b7f3294c01', 'request_id': 'req-0326212e-982c-4543-9e14-8d856a3c0529'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:49.042876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.043680 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.050696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af3023818cc4d1b8d2924b7f3294c01', 'request_id': 'req-0326212e-982c-4543-9e14-8d856a3c0529'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:49.060088 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af3023818cc4d1b8d2924b7f3294c01', 'request_id': 'req-0326212e-982c-4543-9e14-8d856a3c0529'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:49.073207 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] The token cache is being invalidate because project 6af3023818cc4d1b8d2924b7f3294c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:49.073489 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:49.074123 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:49.075620 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1375/2735] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:48 2022] DELETE /identity/v3/projects/6af3023818cc4d1b8d2924b7f3294c01 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:49.088905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] MFA Rules not processed for user `edb2fa38e97a42f0860ef05502ea3edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:49.088905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:49.175413 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1361/2736] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:49.180734 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.182260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:49.265704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326212e-982c-4543-9e14-8d856a3c0529 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.271189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.271875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.272154 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.272423 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.273064 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.275028 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.314865 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1376/2737] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:15:49 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:15:49.319229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.324721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:49.332545 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260487c-ba0a-4aab-88aa-3b39108a9eb0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.395157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.395675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.395977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.396241 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.396857 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.398768 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.422393 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1362/2738] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:15:49 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:15:49.427363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.441570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5aa-7d1c-4928-9f48-f6a7486d9c39 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.446912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.447516 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.447825 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.448090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.448741 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.450359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.460741 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1377/2739] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:15:49.465337 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.475994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f18a49-1006-4b48-82c7-af5824b47090 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.481432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.482100 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.482345 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.482617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] PATH_INFO: `/v3/projects/2c0215303f004363b6aaaf6af85c3d15/users/c6bdd08a750243908ccd80f9b5f6273f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.499170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0215303f004363b6aaaf6af85c3d15, user_id=c6bdd08a750243908ccd80f9b5f6273f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.501877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.517398 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1363/2740] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:49 2022] PUT /identity/v3/projects/2c0215303f004363b6aaaf6af85c3d15/users/c6bdd08a750243908ccd80f9b5f6273f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:49.521826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.532508 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a754-61b5-440f-a529-50cc9cf01179 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.580188 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:49.595658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.596311 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.596611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.597073 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.598189 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.599899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add48d58-50a3-4a01-99b9-4479dc974fed admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.611238 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1378/2741] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:15:49.615038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:49.626149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9581a8-dc2f-4a2b-8fd2-d5cda77144e9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:49.638518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:49.639327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:49.639611 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:49.639905 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] PATH_INFO: `/v3/projects/2c0215303f004363b6aaaf6af85c3d15/users/c6bdd08a750243908ccd80f9b5f6273f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:49.641915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0215303f004363b6aaaf6af85c3d15, user_id=c6bdd08a750243908ccd80f9b5f6273f, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:49.644639 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22179808-8f43-4a1e-8a54-1c2a4573b23a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:49.656877 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1364/2742] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:15:49 2022] PUT /identity/v3/projects/2c0215303f004363b6aaaf6af85c3d15/users/c6bdd08a750243908ccd80f9b5f6273f/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:50.291376 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:50.291662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:50.297471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:50.326570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] MFA Rules not processed for user `c6bdd08a750243908ccd80f9b5f6273f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:50.327831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:50.412676 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1379/2743] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:50.414748 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:50.415091 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:50.415427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:50.435628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] MFA Rules not processed for user `edb2fa38e97a42f0860ef05502ea3edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:50.437158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:50.497036 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1365/2744] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:50.511346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:50.513453 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:50.597183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5f0a3-fd09-4c1e-ac91-64326ea6f5af None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:50.605313 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:50.606221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:50.606594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:50.606904 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:50.617793 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:50.619391 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:50.628496 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1380/2745] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:50.882621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:50.884426 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:50.952022 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08976aa0-f530-45f0-8e04-1fa8a24cec1f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:50.955935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:50.956280 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:50.956554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:50.956823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:50.958554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:50.968642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:50.971149 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5987953-4ae4-4823-a266-d729b9ba3c67 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:50.979453 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1366/2746] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:56.010532 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:56.012906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:56.075377 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:56.081635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ae93-ea13-4e74-813c-797b864f9401 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:56.087077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:56.087807 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:56.088156 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:56.088384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] PATH_INFO: `/v3/users/0eca5a6708cb4e5199f311d872cd489e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:56.089612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eca5a6708cb4e5199f311d872cd489e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:56.091444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:56.142766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eca5a6708cb4e5199f311d872cd489e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.143416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eca5a6708cb4e5199f311d872cd489e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.153211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eca5a6708cb4e5199f311d872cd489e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.160780 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eca5a6708cb4e5199f311d872cd489e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.173801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eca5a6708cb4e5199f311d872cd489e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.180122 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1381/2747] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:56 2022] DELETE /identity/v3/users/0eca5a6708cb4e5199f311d872cd489e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:56.185148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:56.185671 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:56.185772 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:56.194173 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:56.207635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:56.208879 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:56.268541 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1367/2748] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:56.278829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:56.280357 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:56.342821 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225792b-c3c7-44d0-be80-945f331d10d1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:56.347091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:56.347704 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:56.348166 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:56.348427 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:56.357890 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:56.359335 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:56.368855 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1382/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:56.665196 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:56.666792 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:56.682666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436cb1f-4c24-4ec2-bff5-e4f8a6e6493e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:56.688981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:56.689485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:56.689797 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:56.690068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] PATH_INFO: `/v3/projects/7d06bfa912bc4d688bc330e6249385fc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:56.691215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d06bfa912bc4d688bc330e6249385fc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:56.693234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:56.742239 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d06bfa912bc4d688bc330e6249385fc', 'request_id': 'req-125296f0-3378-40d2-b9be-efa3083b1b13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.748016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d06bfa912bc4d688bc330e6249385fc', 'request_id': 'req-125296f0-3378-40d2-b9be-efa3083b1b13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.758271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d06bfa912bc4d688bc330e6249385fc', 'request_id': 'req-125296f0-3378-40d2-b9be-efa3083b1b13'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.769664 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] The token cache is being invalidate because project 7d06bfa912bc4d688bc330e6249385fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:56.769976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.770939 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-125296f0-3378-40d2-b9be-efa3083b1b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:56.772556 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1368/2750] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:56 2022] DELETE /identity/v3/projects/7d06bfa912bc4d688bc330e6249385fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:02.964336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:02.966279 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:02.980729 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ef1a-7dfe-42ea-b5d6-67abcf6f7508 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.045001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.045820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.046105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.046389 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] PATH_INFO: `/v3/users/e326b2750f604509aa2375a7a42d8f7f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.047976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e326b2750f604509aa2375a7a42d8f7f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.050232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.074554 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:03.104174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e326b2750f604509aa2375a7a42d8f7f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.104822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e326b2750f604509aa2375a7a42d8f7f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.113179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e326b2750f604509aa2375a7a42d8f7f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.120555 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e326b2750f604509aa2375a7a42d8f7f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.132510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e326b2750f604509aa2375a7a42d8f7f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.138240 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1383/2751] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:02 2022] DELETE /identity/v3/users/e326b2750f604509aa2375a7a42d8f7f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:03.143026 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.143525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.143635 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.164229 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:03.165431 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.227294 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1369/2752] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:03.237968 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.239472 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.308663 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32dba-8af8-48f4-990a-81219fa21605 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.313063 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.313680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.313950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.314212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.324066 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.325518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.336759 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1384/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:03.624682 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.626160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.639374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573ba4-8f0f-4b8f-819f-c5c9ec661ab6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.644250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.644903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.645144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.645409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] PATH_INFO: `/v3/projects/fdb8ffa7611f42fdbe7615c86a980fa6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.646552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb8ffa7611f42fdbe7615c86a980fa6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.648725 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.676012 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:03.708460 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb8ffa7611f42fdbe7615c86a980fa6', 'request_id': 'req-fd40c173-7b3e-4e58-bb32-8ea536911f3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.710493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.712005 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.714668 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb8ffa7611f42fdbe7615c86a980fa6', 'request_id': 'req-fd40c173-7b3e-4e58-bb32-8ea536911f3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.724036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb8ffa7611f42fdbe7615c86a980fa6', 'request_id': 'req-fd40c173-7b3e-4e58-bb32-8ea536911f3c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.736981 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] The token cache is being invalidate because project fdb8ffa7611f42fdbe7615c86a980fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:03.737172 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.737809 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fd40c173-7b3e-4e58-bb32-8ea536911f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:03.739300 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1370/2754] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:03 2022] DELETE /identity/v3/projects/fdb8ffa7611f42fdbe7615c86a980fa6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:03.744738 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d197-5df0-40f0-ad31-479100d62473 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.745021 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d197-5df0-40f0-ad31-479100d62473 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.745293 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d197-5df0-40f0-ad31-479100d62473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.766210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-06a2d197-5df0-40f0-ad31-479100d62473 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:03.767453 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-06a2d197-5df0-40f0-ad31-479100d62473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.775425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd273e2-57b0-49b7-b6ac-e34d50fb5009 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.826780 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1371/2755] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:16:03.829875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.830483 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.830755 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.831023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.832802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.835153 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.835443 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.835843 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.842623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:03.857129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:03.858406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:03.866469 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1372/2756] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:16:03.870574 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.879343 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4eb0-d281-4a7a-b631-dd303047f6f2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.884525 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.885119 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.885390 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.885652 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.886284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:03.886579 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.888220 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.899403 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.900119 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1373/2757] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:03.901071 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.904262 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.911852 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1385/2758] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:03.916312 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d16b5-d5b7-4da2-8639-2d7ab29884dd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:03.920944 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:03.921561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:03.921810 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:03.922077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:03.922698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:03.924627 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:03.953819 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1374/2759] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:03 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:03.958316 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:03.970384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797cac5-7240-4ca6-bee5-c7a33025225e service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.029457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.030083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.030364 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.030634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.031959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.034277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.063460 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1386/2760] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:03 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:04.064683 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:04.075535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6b1aa-d8e9-49dd-81fa-d3d01f4cc83a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.081044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.081648 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.081919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.082182 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.082877 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.084747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.096419 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1375/2761] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:16:04.100369 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:04.110699 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd30e-d91e-4f38-887e-89cde83272eb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.115685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.116396 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.116764 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.117041 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.117700 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.119322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce072-12d4-4da7-9a7d-2309ce46c90e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.130711 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1387/2762] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:04.134934 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:04.146210 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4d0b-be57-4673-8aec-1ad6ca3c29f1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.152122 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.152816 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.153084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.153376 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] PATH_INFO: `/v3/projects/83511d6d4a2b4bd19c0f7608742a2a53/users/8cfe1463710644e78d115ee24aa52fb5/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.169461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83511d6d4a2b4bd19c0f7608742a2a53, user_id=8cfe1463710644e78d115ee24aa52fb5, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.172146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.188448 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1376/2763] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:04 2022] PUT /identity/v3/projects/83511d6d4a2b4bd19c0f7608742a2a53/users/8cfe1463710644e78d115ee24aa52fb5/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:04.194036 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367872-afd4-48f1-8772-07fc194218b9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.194380 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367872-afd4-48f1-8772-07fc194218b9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.194654 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367872-afd4-48f1-8772-07fc194218b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.214765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-df367872-afd4-48f1-8772-07fc194218b9 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:04.216074 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-df367872-afd4-48f1-8772-07fc194218b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:04.280093 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1388/2764] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:04.296584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:04.298362 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:04.333925 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:04.359261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1dde-550c-4edb-aa3e-d738f8193fcd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:04.362813 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:04.363418 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:04.363690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:04.363987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:04.373557 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:04.375046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:04.384767 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1377/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:09.208353 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.208993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.208993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.239766 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] MFA Rules not processed for user `8cfe1463710644e78d115ee24aa52fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:09.241362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:09.253660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:09.316549 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1389/2766] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:09.321224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.331183 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d309b-535c-420d-b94a-d147c1af68d5 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.336046 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.336655 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.336919 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.337184 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.337831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.339705 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.369538 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1378/2767] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:09 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:09.373950 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.391149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790e77-8ff3-4283-911f-0a1b77e696f9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.474751 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.475827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.476234 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.476504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.477128 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.479061 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.504119 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1390/2768] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:09 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:09.512132 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.526628 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135127-9105-4fcb-af0f-085cba2115ac admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.533786 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.534746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.535213 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.535658 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.536778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.538886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.550946 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1379/2769] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:09.556090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.570844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fba545-4c9e-452a-ab17-500bb1e18fc2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.575907 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.576570 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.576845 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.577112 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] PATH_INFO: `/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b/users/a50ec202c7754220b7e08678b7bfaecc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.593265 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a3d85cc9c9430f8c2119de7e72fe4b, user_id=a50ec202c7754220b7e08678b7bfaecc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.595983 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.611324 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1391/2770] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:09 2022] PUT /identity/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b/users/a50ec202c7754220b7e08678b7bfaecc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:09.615356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.628961 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5382d61-f2d1-4e82-94cb-4c63f6213616 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.687570 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.688208 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.688480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.688742 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.689407 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.691019 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec27c0-d9d8-4654-8f84-79f299d74f50 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.701092 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1380/2771] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:09.705648 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:09.720201 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a814f-c3d8-40e4-8f95-3695795161df admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:09.726883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:09.727561 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:09.727973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:09.728273 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] PATH_INFO: `/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b/users/a50ec202c7754220b7e08678b7bfaecc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:09.731573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a3d85cc9c9430f8c2119de7e72fe4b, user_id=a50ec202c7754220b7e08678b7bfaecc, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:09.734621 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:09.746465 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1392/2772] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:09 2022] PUT /identity/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b/users/a50ec202c7754220b7e08678b7bfaecc/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:14.418007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d37d-225f-4aa0-a4bb-784ff10f6e23 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:14.418482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d37d-225f-4aa0-a4bb-784ff10f6e23 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:14.418482 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d37d-225f-4aa0-a4bb-784ff10f6e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:14.464906 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-36a9d37d-225f-4aa0-a4bb-784ff10f6e23 None None] MFA Rules not processed for user `a50ec202c7754220b7e08678b7bfaecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:14.467935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-36a9d37d-225f-4aa0-a4bb-784ff10f6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:14.561969 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1381/2773] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:14.575144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:14.577562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:14.641111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d7fc-8438-4770-a291-33f3335716ee admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:14.644409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:14.645031 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:14.645317 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:14.645596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:14.670360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:14.721820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:14.723556 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:14.735932 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1393/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:14.883662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fab4-dd2c-4beb-816e-0029b2ed521d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:14.883970 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fab4-dd2c-4beb-816e-0029b2ed521d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:14.884553 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fab4-dd2c-4beb-816e-0029b2ed521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:14.908134 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-72e0fab4-dd2c-4beb-816e-0029b2ed521d None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:14.909638 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-72e0fab4-dd2c-4beb-816e-0029b2ed521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:14.932336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:14.977710 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1382/2775] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:15.029665 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:15.031531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:15.107878 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a3ce-b0c0-42c5-a96c-4ebe280345d6 service glance] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:15.112767 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:15.113378 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:15.113650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:15.113913 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:15.122529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:15.124171 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:15.132783 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1394/2776] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:23.926079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:23.926685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:23.926685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:23.947358 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] MFA Rules not processed for user `8cfe1463710644e78d115ee24aa52fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:23.948601 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:23.955595 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1383/2777] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:25.129110 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=50 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:25.352100 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:25.353896 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:25.426934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e79d-846f-4db5-a99c-523d045a2bc7 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:25.432153 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:25.432799 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:25.433076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:25.433347 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] PATH_INFO: `/v3/users/edb2fa38e97a42f0860ef05502ea3edf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:25.434524 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb2fa38e97a42f0860ef05502ea3edf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:25.436557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:25.488594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb2fa38e97a42f0860ef05502ea3edf'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.489442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb2fa38e97a42f0860ef05502ea3edf'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.500696 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb2fa38e97a42f0860ef05502ea3edf'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.509103 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb2fa38e97a42f0860ef05502ea3edf'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.521545 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb2fa38e97a42f0860ef05502ea3edf'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.527614 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1395/2778] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:25 2022] DELETE /identity/v3/users/edb2fa38e97a42f0860ef05502ea3edf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:25.716473 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:25.727924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb1983-4913-4a3d-bd3c-de89e8c508e9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:25.789216 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:25.789923 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:25.790202 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:25.790471 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] PATH_INFO: `/v3/projects/adda3c0004104bb0aeb0c2440285574f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:25.791983 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adda3c0004104bb0aeb0c2440285574f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:25.794675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:25.848575 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adda3c0004104bb0aeb0c2440285574f', 'request_id': 'req-8ec25d00-a505-434b-a984-80dcc8a60027'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.854375 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adda3c0004104bb0aeb0c2440285574f', 'request_id': 'req-8ec25d00-a505-434b-a984-80dcc8a60027'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.863174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adda3c0004104bb0aeb0c2440285574f', 'request_id': 'req-8ec25d00-a505-434b-a984-80dcc8a60027'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.874958 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] The token cache is being invalidate because project adda3c0004104bb0aeb0c2440285574f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:25.875163 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.875900 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8ec25d00-a505-434b-a984-80dcc8a60027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:25.877482 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1384/2779] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:25 2022] DELETE /identity/v3/projects/adda3c0004104bb0aeb0c2440285574f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:25.881714 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:25.883359 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:25.897387 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e66c4-8949-47f6-a372-8c85e8457e67 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:25.957874 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:25.958507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:25.959612 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:25.959912 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] PATH_INFO: `/v3/users/c6bdd08a750243908ccd80f9b5f6273f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:25.961256 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bdd08a750243908ccd80f9b5f6273f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:25.963280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:25.988468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:26.037773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bdd08a750243908ccd80f9b5f6273f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.038518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bdd08a750243908ccd80f9b5f6273f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.054782 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bdd08a750243908ccd80f9b5f6273f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.073871 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bdd08a750243908ccd80f9b5f6273f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.102057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bdd08a750243908ccd80f9b5f6273f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.109814 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1396/2780] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:25 2022] DELETE /identity/v3/users/c6bdd08a750243908ccd80f9b5f6273f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:26.280125 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.280409 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.281009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.305573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:26.307084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:26.363159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:26.374904 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1385/2781] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Aug 21 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:26.387399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:26.389212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:26.462372 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7890f-e9ff-4b19-b07d-bb2381805f0f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:26.467959 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:26.468442 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.468716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.468980 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.480032 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:26.482135 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631b29-5839-42ab-9c04-a78bfbfcd1cd service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:26.492332 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1397/2782] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:16:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:26.498223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:26.499866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:26.602128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d05d-6c5a-4fdc-b1df-49fe27383a19 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:26.609339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:26.610167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.610497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.610734 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] PATH_INFO: `/v3/projects/2c0215303f004363b6aaaf6af85c3d15` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.616228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0215303f004363b6aaaf6af85c3d15)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:26.619632 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:26.695223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0215303f004363b6aaaf6af85c3d15', 'request_id': 'req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.708979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0215303f004363b6aaaf6af85c3d15', 'request_id': 'req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.722427 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0215303f004363b6aaaf6af85c3d15', 'request_id': 'req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.746938 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] The token cache is being invalidate because project 2c0215303f004363b6aaaf6af85c3d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:26.747371 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.748278 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff416eb6-24a5-4b4c-88bf-6e1bf63577dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:26.750506 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1386/2783] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:26 2022] DELETE /identity/v3/projects/2c0215303f004363b6aaaf6af85c3d15 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:26.755460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183729-c8db-4263-b568-931345a0b58e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.755852 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183729-c8db-4263-b568-931345a0b58e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.756150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183729-c8db-4263-b568-931345a0b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.776891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e7183729-c8db-4263-b568-931345a0b58e None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:26.778114 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e7183729-c8db-4263-b568-931345a0b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:26.854592 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1398/2784] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:26.855273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.855712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.856565 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.905101 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:26.907352 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:26.931452 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1387/2785] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:16:26.932507 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183729-c8db-4263-b568-931345a0b58e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:26.949530 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183729-c8db-4263-b568-931345a0b58e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:26.956122 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:26.956775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:26.957033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:26.957296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:26.957993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:26.958246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:26.961281 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:26.980277 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1399/2786] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:26.980698 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:26.995452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0c57-d132-4d5c-8182-adc5aca81283 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.008037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.008761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.009036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.009530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.010449 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.013340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.058958 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1388/2787] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:26 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:27.063081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:27.077608 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2329-3593-4e74-bb6f-c7d6d1b111f1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.109195 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:27.200826 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.201448 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.201788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.202125 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.202829 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.204897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.235731 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1400/2788] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:27 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:27.237045 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:27.253366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29eb25-db77-4de8-8ac9-97eef6899345 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.270909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.271838 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.272258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.272935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.273842 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.275530 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.303221 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1389/2789] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:27.307689 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:27.321333 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7ff2-c5eb-4774-867d-df7deab62c96 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.328670 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.329667 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.330434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.330939 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.332105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.334948 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a1a45-dea3-4730-b96f-7a98b8a481f4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.351589 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1401/2790] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:27.356221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:27.373778 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75f22-ff55-4e63-aa93-15ae20f4db0b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.390490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.393704 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.394328 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.396049 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] PATH_INFO: `/v3/projects/25325d10a4634db8adc76f5c21c9c774/users/ae7050c51df74f45b900728346dc7751/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.439309 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25325d10a4634db8adc76f5c21c9c774, user_id=ae7050c51df74f45b900728346dc7751, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.442157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.459716 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1390/2791] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:27 2022] PUT /identity/v3/projects/25325d10a4634db8adc76f5c21c9c774/users/ae7050c51df74f45b900728346dc7751/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:16:27.473056 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.474140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.474140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.514919 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] MFA Rules not processed for user `ae7050c51df74f45b900728346dc7751`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:27.517217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:27.611014 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1402/2792] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:27.619433 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:27.623452 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:27.658903 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:27.696994 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e594f-0de2-4438-97ac-68159ecb502b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:27.701490 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:27.702540 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:27.702897 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:27.703236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:27.713284 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:27.714659 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd1f7-da7d-437f-a116-ca61a81285f4 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:27.723388 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1391/2793] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:33.352844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:33.446057 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d19e0-4a5d-43a5-a40a-0e36e493010c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:33.458179 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:33.459399 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:33.459934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:33.460417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] PATH_INFO: `/v3/users/ae7050c51df74f45b900728346dc7751` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:33.461822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7050c51df74f45b900728346dc7751)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:33.472510 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:33.510373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:33.532690 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7050c51df74f45b900728346dc7751'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:33.533249 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7050c51df74f45b900728346dc7751'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:33.542732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7050c51df74f45b900728346dc7751'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:33.551680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7050c51df74f45b900728346dc7751'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:33.565212 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7050c51df74f45b900728346dc7751'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:33.571322 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1403/2794] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:33 2022] DELETE /identity/v3/users/ae7050c51df74f45b900728346dc7751 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:33.576380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:33.576979 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:33.577098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:33.598258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:33.599613 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:33.669094 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1392/2795] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:16:33.680434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:33.682140 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:33.755611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775e1c-43a3-4965-9f5f-c9be14bd44c8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:33.759668 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:33.760301 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:33.760575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:33.760867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:33.771054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:33.772651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37836-34d7-44d7-8e48-6f8f5f23f984 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:33.783296 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1404/2796] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:34.065002 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.066543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:34.081071 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c8ff-486d-4fba-ba38-495803379330 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.088676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.089340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.089602 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.089868 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] PATH_INFO: `/v3/projects/25325d10a4634db8adc76f5c21c9c774` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.090996 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25325d10a4634db8adc76f5c21c9c774)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.092989 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.145405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25325d10a4634db8adc76f5c21c9c774', 'request_id': 'req-bbe9697e-8852-4810-af9f-1630096d882c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:34.154571 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25325d10a4634db8adc76f5c21c9c774', 'request_id': 'req-bbe9697e-8852-4810-af9f-1630096d882c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:34.164714 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25325d10a4634db8adc76f5c21c9c774', 'request_id': 'req-bbe9697e-8852-4810-af9f-1630096d882c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:34.175687 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] The token cache is being invalidate because project 25325d10a4634db8adc76f5c21c9c774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:34.176048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:34.176740 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bbe9697e-8852-4810-af9f-1630096d882c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:34.178536 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1393/2797] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:34 2022] DELETE /identity/v3/projects/25325d10a4634db8adc76f5c21c9c774 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:34.183647 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.183957 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.184233 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.204781 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:34.206023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:34.263309 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1405/2798] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:34.274336 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.274619 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.274893 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.297249 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:34.298480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:34.308043 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1394/2799] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:34.312726 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.323001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4debfe0-88a6-4d55-8309-d77a9d028988 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.328010 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.328619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.328897 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.329170 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.329828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:34.330131 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.331804 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.344965 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1406/2800] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:34.351643 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.367090 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00ac2-4079-48bf-8858-6865378c7e5c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.375931 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.376880 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.377236 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.377582 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.378485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.381774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.415279 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1395/2801] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:34.419682 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.433250 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab320-28cb-4eb7-8510-63f3ad97f97f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.464150 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:34.496246 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.496858 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.497493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.497493 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.498008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.500086 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.526911 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1407/2802] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:34.531519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.543144 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90315e7-34da-42b0-82f8-d0c8530c749b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.549258 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.550047 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.550380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.550599 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.551254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.552975 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.564904 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1396/2803] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:34.569120 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.580067 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fffc0-fd19-46ac-af0a-b30ae2b7f538 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.585312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.586159 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.586496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.586840 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.587585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.589361 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f0e20-85ec-42ee-890d-9621b5e858b0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.605535 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1408/2804] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:34.606830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.618098 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca739-0b29-41a9-ab3d-6b796415df20 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.624037 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.624729 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.625056 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.625458 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] PATH_INFO: `/v3/projects/c05a8b25a2fa496586879f795371a75c/users/a4eb651163014bb3adf2f4bb154bbba3/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.637250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:34.646730 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05a8b25a2fa496586879f795371a75c, user_id=a4eb651163014bb3adf2f4bb154bbba3, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.650629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.667302 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1397/2805] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:34 2022] PUT /identity/v3/projects/c05a8b25a2fa496586879f795371a75c/users/a4eb651163014bb3adf2f4bb154bbba3/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:34.678710 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.678996 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.679264 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.709277 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] MFA Rules not processed for user `a4eb651163014bb3adf2f4bb154bbba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:34.710623 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:34.775369 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1409/2806] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:34.780128 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.844468 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587566e5-43fb-4ea9-a5fd-038eb5bc4691 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.849339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.849986 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.850224 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.850493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.851271 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.853286 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.884021 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1398/2807] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:34.899945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:34.899945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d56e8f-f789-4ae9-a778-6fcffec4caec None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:34.958572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:34.959244 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:34.959633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:34.959934 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:34.960584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:34.962538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:34.987482 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1410/2808] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:34 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:34.991888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.003042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c6f-1f7f-4ac0-9323-ff7399f9d521 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.009287 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.010113 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.010952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.010952 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.011519 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.013232 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.024624 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1399/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:35.028877 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.039557 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca45b4-b5e9-416a-a575-d0c7a3f49f82 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.044394 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.045065 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.045381 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.045640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.046467 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.048660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c10afb-5860-4f95-a78b-99fe9a9a381a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.060384 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1411/2810] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:35.065036 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.075573 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db58fd-3a99-4ac4-8c6d-e9724e616f20 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.082666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.084067 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.084331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.084666 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] PATH_INFO: `/v3/projects/01dbc42a7e3d43c089b2d27257e23442/users/06a784bce7c54d099d9acfab58aaf9c8/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.100756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dbc42a7e3d43c089b2d27257e23442, user_id=06a784bce7c54d099d9acfab58aaf9c8, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.103831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.118656 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1400/2811] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:35 2022] PUT /identity/v3/projects/01dbc42a7e3d43c089b2d27257e23442/users/06a784bce7c54d099d9acfab58aaf9c8/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:35.129169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.129426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.129675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.162785 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] MFA Rules not processed for user `06a784bce7c54d099d9acfab58aaf9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:35.164813 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:35.173977 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:35.243150 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1412/2812] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:35.247871 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.320510 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df5db5-f623-4917-8da8-592aa17e6b52 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.325774 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.326609 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.326890 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.327158 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.328039 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.330161 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.362956 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1401/2813] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:35 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:35.364247 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.375058 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640103c-bf91-496c-bfde-9d827b8c8cb2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.432824 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.433529 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.433697 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.433962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.434586 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.436685 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.458612 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1413/2814] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:35 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:35.463013 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.474552 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03962fb-b710-495a-8cbc-89036daf9684 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.479600 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.480402 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.480690 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.481052 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.481889 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.483513 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.495977 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1402/2815] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:16:35.500401 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.512232 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d7ca-ee2f-4ad2-88b6-ca114e20966c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.517875 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.518708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.518979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.519240 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] PATH_INFO: `/v3/projects/17533949cef948bf9b358a068c71f182/users/e30a46d4db50425c8434cce90a254aaa/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.537278 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] RBAC: Authorizing `identity:create_grant(project_id=17533949cef948bf9b358a068c71f182, user_id=e30a46d4db50425c8434cce90a254aaa, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.540016 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.560752 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1414/2816] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:35 2022] PUT /identity/v3/projects/17533949cef948bf9b358a068c71f182/users/e30a46d4db50425c8434cce90a254aaa/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:35.564912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.575378 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70097f7-126e-4b5e-9829-97972cabeb5b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.586203 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:35.644114 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.644854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.644980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.645228 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.645870 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.647675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1725f-ae38-4b83-ad73-69633691bafa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.658092 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1403/2817] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:16:35.662546 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.673048 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330db80-6510-4ec0-b352-4776f47a06df admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.677881 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.678525 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.678802 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.679060 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] PATH_INFO: `/v3/projects/17533949cef948bf9b358a068c71f182/users/e30a46d4db50425c8434cce90a254aaa/roles/2d0f2944dd3d4b8b84280aa1f49bfd33` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.681271 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17533949cef948bf9b358a068c71f182, user_id=e30a46d4db50425c8434cce90a254aaa, role_id=2d0f2944dd3d4b8b84280aa1f49bfd33)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.683943 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.696264 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1415/2818] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:35 2022] PUT /identity/v3/projects/17533949cef948bf9b358a068c71f182/users/e30a46d4db50425c8434cce90a254aaa/roles/2d0f2944dd3d4b8b84280aa1f49bfd33 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:35.707988 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.708242 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.708543 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.741640 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] MFA Rules not processed for user `e30a46d4db50425c8434cce90a254aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:35.742830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:35.813064 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1404/2819] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:35.825597 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:35.828718 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:35.896716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912259c0-1073-409a-bba6-e0ebc0add849 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:35.901518 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:35.902124 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:35.902424 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:35.902674 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:35.918001 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:35.965742 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:35.967211 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:35.976543 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1416/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:37.527622 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:37.530059 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:37.545888 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ff54-9aac-41e0-8265-2cb80a32f7f0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:37.550171 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:37.550767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:37.551042 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:37.551302 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:37.620924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:37.622285 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:37.631867 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1405/2821] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:38.207772 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:38.217609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a840b-f2cc-4d82-81c9-e0280afc62c1 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:38.221638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:38.222243 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:38.222490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:38.222762 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:38.233436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:38.234882 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe38b-0886-48d6-b266-067e0758cd12 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:38.245236 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1417/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:42.208817 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:42.243397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:42.276234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde28c25-c22c-46a9-bb7d-2ac836c69f16 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:42.281901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:42.282564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:42.282802 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:42.283079 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] PATH_INFO: `/v3/users/a4eb651163014bb3adf2f4bb154bbba3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:42.284498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4eb651163014bb3adf2f4bb154bbba3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:42.286445 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:42.337429 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4eb651163014bb3adf2f4bb154bbba3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.349361 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4eb651163014bb3adf2f4bb154bbba3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.357148 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4eb651163014bb3adf2f4bb154bbba3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.357873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4eb651163014bb3adf2f4bb154bbba3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.358581 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4eb651163014bb3adf2f4bb154bbba3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.370944 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1406/2823] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:42 2022] DELETE /identity/v3/users/a4eb651163014bb3adf2f4bb154bbba3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:16:42.375540 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:42.376085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:42.376187 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:42.394854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:42.396014 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:42.455656 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1418/2824] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:42.466053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:42.467485 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:42.528608 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b881-3fb5-4c69-bb85-4f37f7d1dde7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:42.533364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:42.533977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:42.534252 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:42.534518 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:42.544480 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:42.546044 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:42.556530 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1407/2825] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:42.837440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:42.839098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:42.855341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87788f-01d7-4bfd-8570-04e42bf82f89 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:42.862310 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:42.862937 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:42.863216 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:42.863486 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] PATH_INFO: `/v3/projects/c05a8b25a2fa496586879f795371a75c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:42.864683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05a8b25a2fa496586879f795371a75c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:42.867552 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:42.924083 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05a8b25a2fa496586879f795371a75c', 'request_id': 'req-18eb4b9f-78e5-451b-822a-0cea64c9115f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.930105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05a8b25a2fa496586879f795371a75c', 'request_id': 'req-18eb4b9f-78e5-451b-822a-0cea64c9115f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.940358 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05a8b25a2fa496586879f795371a75c', 'request_id': 'req-18eb4b9f-78e5-451b-822a-0cea64c9115f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.952363 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] The token cache is being invalidate because project c05a8b25a2fa496586879f795371a75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:42.952732 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.953460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:42.955076 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1419/2826] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:42 2022] DELETE /identity/v3/projects/c05a8b25a2fa496586879f795371a75c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:42.959080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:42.968858 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd76d-09cf-4ed9-bb70-690c8bf817cf service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:43.016377 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:43.027181 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:43.027855 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:43.028313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:43.028595 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] PATH_INFO: `/v3/users/06a784bce7c54d099d9acfab58aaf9c8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:43.029831 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a784bce7c54d099d9acfab58aaf9c8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:43.032140 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:43.081069 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a784bce7c54d099d9acfab58aaf9c8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.093199 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a784bce7c54d099d9acfab58aaf9c8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.101784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a784bce7c54d099d9acfab58aaf9c8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.102370 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a784bce7c54d099d9acfab58aaf9c8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.102953 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a784bce7c54d099d9acfab58aaf9c8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.116946 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1408/2827] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:42 2022] DELETE /identity/v3/users/06a784bce7c54d099d9acfab58aaf9c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:43.405873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:43.407440 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:43.422338 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4b9f-78e5-451b-822a-0cea64c9115f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:43.448615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:43.482042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:43.482594 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:43.482872 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:43.483137 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] PATH_INFO: `/v3/projects/01dbc42a7e3d43c089b2d27257e23442` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:43.484272 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dbc42a7e3d43c089b2d27257e23442)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:43.486183 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:43.539049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dbc42a7e3d43c089b2d27257e23442', 'request_id': 'req-4ca4d8d9-725d-423a-a252-cc8516bd31b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.544756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dbc42a7e3d43c089b2d27257e23442', 'request_id': 'req-4ca4d8d9-725d-423a-a252-cc8516bd31b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.554147 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dbc42a7e3d43c089b2d27257e23442', 'request_id': 'req-4ca4d8d9-725d-423a-a252-cc8516bd31b7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.566432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] The token cache is being invalidate because project 01dbc42a7e3d43c089b2d27257e23442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:43.566712 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.567362 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.568959 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1420/2828] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:43 2022] DELETE /identity/v3/projects/01dbc42a7e3d43c089b2d27257e23442 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:43.575461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:43.577397 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:43.592830 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364c23f-d597-4ae4-ba65-3130291f0f77 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:43.662497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:43.663143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:43.663487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:43.663815 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] PATH_INFO: `/v3/users/e30a46d4db50425c8434cce90a254aaa` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:43.665129 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30a46d4db50425c8434cce90a254aaa)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:43.667086 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:43.715497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30a46d4db50425c8434cce90a254aaa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.727685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30a46d4db50425c8434cce90a254aaa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.736305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30a46d4db50425c8434cce90a254aaa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.736845 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30a46d4db50425c8434cce90a254aaa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.737472 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-841c340c-b78c-4792-b845-136bf19abab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30a46d4db50425c8434cce90a254aaa'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:43.739489 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:43.752915 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1409/2829] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:16:43 2022] DELETE /identity/v3/users/e30a46d4db50425c8434cce90a254aaa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:16:44.061578 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.063023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:44.076117 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d8d9-725d-423a-a252-cc8516bd31b7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.139136 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.139812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.140095 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.140368 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] PATH_INFO: `/v3/projects/17533949cef948bf9b358a068c71f182` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.141490 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17533949cef948bf9b358a068c71f182)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.143418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.195691 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17533949cef948bf9b358a068c71f182', 'request_id': 'req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:44.201049 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17533949cef948bf9b358a068c71f182', 'request_id': 'req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:44.202715 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:44.210548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17533949cef948bf9b358a068c71f182', 'request_id': 'req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:44.225662 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] The token cache is being invalidate because project 17533949cef948bf9b358a068c71f182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:16:44.226471 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:44.227210 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a4bb77d3-9ffa-4eb3-a5d0-e644d248f903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:16:44.229037 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1421/2830] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:44 2022] DELETE /identity/v3/projects/17533949cef948bf9b358a068c71f182 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:16:44.234107 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.234400 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.234726 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.254685 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:44.256170 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:44.322220 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1410/2831] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:44.330562 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.330861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.331094 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.358169 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:44.359539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:44.373200 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1422/2832] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:44.377498 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.387977 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db370b-3046-4afa-b5b1-2f14f16a4abd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.392924 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.393621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.393935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.394205 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.394956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:16:44.395264 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.396886 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.410314 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1411/2833] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:16:44.414902 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.425040 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7deea-4797-4250-bbfa-e9646860f01d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.430880 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.431501 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.431801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.432072 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.432703 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.434642 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.464741 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1423/2834] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:16:44 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:16:44.469214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.481976 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb490da-5a4a-4bb9-9676-a94352df496e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.547380 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.548074 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.548350 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.548617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.549496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.553138 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.580093 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1412/2835] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:16:44 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:16:44.584236 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.595360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cef5a-3511-4e40-b3b5-82a069e9e7a7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.600517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.601111 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.601384 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.601651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.602302 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.603949 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.614681 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1424/2836] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:16:44.619143 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.629737 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8907e4-d63a-4334-bf15-154ec7d50869 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.634978 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.635463 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.635766 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.636048 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.636676 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.638254 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418096b-0b94-40aa-bd8b-89831b5d010e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.652726 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1413/2837] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:16:44.657565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.668257 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd5410-e36b-45dd-ab1b-771256a91f02 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.672886 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.673539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.673811 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.674077 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] PATH_INFO: `/v3/projects/70a8b25f0fc7419d9cf3124c2e67a75e/users/ad6d76ce8a7f41eb8075afa0e9e31146/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.690731 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a8b25f0fc7419d9cf3124c2e67a75e, user_id=ad6d76ce8a7f41eb8075afa0e9e31146, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.693455 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.707984 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1425/2838] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:16:44 2022] PUT /identity/v3/projects/70a8b25f0fc7419d9cf3124c2e67a75e/users/ad6d76ce8a7f41eb8075afa0e9e31146/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:16:44.718752 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.719038 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.719305 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.748711 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] MFA Rules not processed for user `ad6d76ce8a7f41eb8075afa0e9e31146`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:16:44.749932 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:44.797334 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:44.817948 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1414/2839] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:16:44.830200 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:44.832087 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:44.897174 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca294c-2172-4381-8aa8-eac7c951e65d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:44.901619 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5bfa3fddfc4d1cb865331a2f5e4d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:44.902228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:44.902504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:44.902773 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:44.911848 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:44.913395 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:44.922243 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1426/2840] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:45.928566 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:16:45.930146 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:45.993167 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ea3d2-1f4c-475b-b8ca-54e1f104d651 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:16:45.997313 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:16:45.997922 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:16:45.998193 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:16:45.998451 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:16:46.000531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:16:46.067617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:16:46.069406 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c98f6b-eecf-4a5b-b1d2-aaef4f95ada9 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:16:46.080916 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1415/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:16:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:16:54.918444 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=57 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:56.075840 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=56 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:06.647803 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.755325 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec041a8-e5fd-4f9c-b4ef-90276d62f1fd service glance] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:06.762792 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:06.763609 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.763993 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.764382 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] PATH_INFO: `/v3/users/ad6d76ce8a7f41eb8075afa0e9e31146` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.766326 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6d76ce8a7f41eb8075afa0e9e31146)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:06.769324 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:06.819891 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6d76ce8a7f41eb8075afa0e9e31146'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.820460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6d76ce8a7f41eb8075afa0e9e31146'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.829452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6d76ce8a7f41eb8075afa0e9e31146'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.837008 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6d76ce8a7f41eb8075afa0e9e31146'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.850550 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6d76ce8a7f41eb8075afa0e9e31146'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:06.856602 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1427/2842] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:06 2022] DELETE /identity/v3/users/ad6d76ce8a7f41eb8075afa0e9e31146 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:06.861215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:06.861719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:06.861719 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:06.913763 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:06.914982 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:06.977687 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1416/2843] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:06.987867 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:06.989312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.031888 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:07.065547 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1e45-8a4d-4922-9f5f-59a3c95275fd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.069861 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.070538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.070728 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.071023 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.080478 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.081937 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956626f-08e8-45f9-b89c-40ecd48824b9 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.091588 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1428/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:07.369912 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.371340 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.385916 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63981-9c32-45d6-bb42-58cf048a47e5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.391221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.391950 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.392226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.392487 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] PATH_INFO: `/v3/projects/70a8b25f0fc7419d9cf3124c2e67a75e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.393775 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a8b25f0fc7419d9cf3124c2e67a75e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.395787 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.451016 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a8b25f0fc7419d9cf3124c2e67a75e', 'request_id': 'req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.456675 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a8b25f0fc7419d9cf3124c2e67a75e', 'request_id': 'req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.465749 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a8b25f0fc7419d9cf3124c2e67a75e', 'request_id': 'req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.477630 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] The token cache is being invalidate because project 70a8b25f0fc7419d9cf3124c2e67a75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:07.477915 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.478606 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2a6d4680-3d58-4c1b-ab2a-cd89dcd052af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:07.480214 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1417/2845] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:07 2022] DELETE /identity/v3/projects/70a8b25f0fc7419d9cf3124c2e67a75e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:07.485345 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.485635 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.485906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.537989 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:07.539180 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.600561 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1429/2846] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:07.669837 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.670160 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.670423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.698554 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:07.699779 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:07.709783 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1418/2847] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:07.713624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.724190 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bb470-a49e-4345-933d-c40e94ce2ced None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.730164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.730763 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.731037 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.731298 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.731974 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:07.732269 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.733870 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.746908 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1430/2848] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:07.751496 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.761891 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a2c45-8153-473c-a558-952db50509fd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.767724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.768353 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.768625 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.768896 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.769536 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.771432 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.802245 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1419/2849] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:07 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:07.808651 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.824531 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319913-c4e1-4909-af5f-f4287580b898 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.895144 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.895806 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.896268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.896542 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.897157 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.899082 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.926755 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1431/2850] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:07 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:07.930875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.941423 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8b3e-8bef-4344-88b7-90b88ad1182a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.947542 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.948204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.948475 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.948743 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.949457 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.951068 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:07.961920 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1420/2851] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:07.966033 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:07.979092 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71475-4127-4919-a6d6-5a5d050a20c2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:07.984820 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:07.985559 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:07.985857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:07.986173 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:07.986839 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:07.988537 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5f699-1f74-4307-8fb6-17eeac4846a6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.002628 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1432/2852] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:08.007466 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.018080 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce98d7-a05a-46c8-bf5e-80b63295bb4b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.024204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.024869 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.025147 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.025405 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] PATH_INFO: `/v3/projects/913b2467c65040d886ff8756cc130468/users/5c936bdc82c24549aaea3ac775cae04c/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.041901 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=913b2467c65040d886ff8756cc130468, user_id=5c936bdc82c24549aaea3ac775cae04c, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.044561 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.046747 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.063460 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1421/2853] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:08 2022] PUT /identity/v3/projects/913b2467c65040d886ff8756cc130468/users/5c936bdc82c24549aaea3ac775cae04c/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:08.076918 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.077373 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.077756 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.093856 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.109676 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] MFA Rules not processed for user `5c936bdc82c24549aaea3ac775cae04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:08.110905 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.183861 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1433/2854] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:08.197945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.200716 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.264617 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4eee5-4bef-4542-b294-cf32880d2bab admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.268696 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.269294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.269564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.269828 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.278721 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.280621 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ec68-3c4d-45c7-a7ab-712ff23f85f5 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.290399 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1422/2855] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:08.314671 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.381485 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93c1be-03f7-4af1-96d4-407366bcdaf5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.386964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.387588 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.387892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.388163 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] PATH_INFO: `/v3/users/5c936bdc82c24549aaea3ac775cae04c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.389417 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c936bdc82c24549aaea3ac775cae04c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.391341 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.452683 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c936bdc82c24549aaea3ac775cae04c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.453280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c936bdc82c24549aaea3ac775cae04c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.462286 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c936bdc82c24549aaea3ac775cae04c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.469336 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c936bdc82c24549aaea3ac775cae04c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.481933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c936bdc82c24549aaea3ac775cae04c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:08.488171 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1434/2856] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:08 2022] DELETE /identity/v3/users/5c936bdc82c24549aaea3ac775cae04c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:08.493478 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.493844 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.494201 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.519244 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:08.520629 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.583416 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1423/2857] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:08.596436 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.598081 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.617460 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.659227 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bc385-64be-485a-89f2-fe9a7977b387 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.663801 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.664409 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.664680 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.664956 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.674638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.676085 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464809-8877-4f1d-a5f0-574687e7f496 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:08.685678 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1435/2858] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:08.972733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:08.974501 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:08.986805 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1f968-7378-4070-a213-e557c6ac0b3f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:08.992589 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:08.993226 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:08.993493 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:08.993756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] PATH_INFO: `/v3/projects/913b2467c65040d886ff8756cc130468` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:08.994974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=913b2467c65040d886ff8756cc130468)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:08.996914 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.045987 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913b2467c65040d886ff8756cc130468', 'request_id': 'req-11fec0da-de34-498e-9a68-fed01813f33d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:09.051920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913b2467c65040d886ff8756cc130468', 'request_id': 'req-11fec0da-de34-498e-9a68-fed01813f33d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:09.060053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913b2467c65040d886ff8756cc130468', 'request_id': 'req-11fec0da-de34-498e-9a68-fed01813f33d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:09.071439 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] The token cache is being invalidate because project 913b2467c65040d886ff8756cc130468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:09.071757 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:09.072404 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11fec0da-de34-498e-9a68-fed01813f33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:09.073922 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1424/2859] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:08 2022] DELETE /identity/v3/projects/913b2467c65040d886ff8756cc130468 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:09.079042 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.079513 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.079634 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.100030 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.101012 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.171408 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1436/2860] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:09.179450 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.179694 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.180015 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.200157 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.201366 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.209551 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1425/2861] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:09.214819 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.228906 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68213f-fa8c-49e9-b1e1-ae3432c528a7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.233827 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.234432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.234711 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.234984 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.235638 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:17:09.235971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.237596 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.249500 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1437/2862] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:17:09.254327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.264646 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94accd-11f3-4f2a-8808-757d34a66a35 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.270027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.270624 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.270929 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.271204 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.271854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.273782 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.286109 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:09.309318 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1426/2863] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:09.313632 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.324788 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c964e-e782-4215-ba63-1963b57f66eb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.389798 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.390400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.390677 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.390945 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.391574 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.393553 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.417277 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1438/2864] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:17:09.421549 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.432862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6475-d83e-4ada-9ecc-01f8469f4f9d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.437584 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.438190 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.438461 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.438731 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.439379 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.440998 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.451553 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1427/2865] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:09.455786 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.466565 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622f91e-8d56-4eed-8783-e4d63e11a16a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.471628 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.472370 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.472650 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.472921 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.473572 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.475505 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7b0a8-e217-4e6b-bdca-ceef35a73b1b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.486700 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1439/2866] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:17:09.491425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.501697 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53c043-140c-4d3b-a832-f7988689bfa8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.507152 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.507875 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.508197 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.508470 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] PATH_INFO: `/v3/projects/f2dfc95caa9e46c68307e86fa6b73acd/users/a5164b2c08824774a5a65496cebba6cd/roles/b3fbac766b24473a8e72d9b338bc8722` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.524392 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2dfc95caa9e46c68307e86fa6b73acd, user_id=a5164b2c08824774a5a65496cebba6cd, role_id=b3fbac766b24473a8e72d9b338bc8722)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.527077 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.541209 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1428/2867] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Aug 21 01:17:09 2022] PUT /identity/v3/projects/f2dfc95caa9e46c68307e86fa6b73acd/users/a5164b2c08824774a5a65496cebba6cd/roles/b3fbac766b24473a8e72d9b338bc8722 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:09.546235 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cdd8a-e627-464e-9617-5ede1b711623 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.546585 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cdd8a-e627-464e-9617-5ede1b711623 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.546860 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cdd8a-e627-464e-9617-5ede1b711623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.566296 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2f8cdd8a-e627-464e-9617-5ede1b711623 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:09.567426 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2f8cdd8a-e627-464e-9617-5ede1b711623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.586217 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:09.637546 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1440/2868] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:09.652007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:09.653974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:09.713535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5c67-fa5c-4575-b1c0-18cdb15ed96d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:09.717641 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244d9918798e46afac5635b7374e0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:09.718255 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:09.718527 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:09.718790 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:09.728326 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:09.729733 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:09.739290 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1429/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:10.390774 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f70f-3a40-4934-8a99-3babb6c84157 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.391331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f70f-3a40-4934-8a99-3babb6c84157 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.391331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f70f-3a40-4934-8a99-3babb6c84157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.422633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5660f70f-3a40-4934-8a99-3babb6c84157 None None] MFA Rules not processed for user `a5164b2c08824774a5a65496cebba6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:10.423927 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5660f70f-3a40-4934-8a99-3babb6c84157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.495305 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1441/2870] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:10.507106 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:10.508662 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:10.569522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd19b-188c-4c8b-ba6f-a2ab5734e58e service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:10.573250 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bc1abc667b4456d89f42912085211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:10.573862 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:10.574135 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:10.574413 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:10.582819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:10.584808 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f420-836d-4c00-915a-17b4407469f0 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:10.593527 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1430/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:11.994321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c457-5bef-40f0-afc6-737b871060db None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:11.995068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c457-5bef-40f0-afc6-737b871060db None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:11.995068 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c457-5bef-40f0-afc6-737b871060db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:12.015411 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c038c457-5bef-40f0-afc6-737b871060db None None] MFA Rules not processed for user `a5164b2c08824774a5a65496cebba6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:12.016645 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c038c457-5bef-40f0-afc6-737b871060db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:12.025342 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1442/2872] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:20.589425 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:22.009850 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=51 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:38.688346 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af302-5a11-4c82-8d4f-9de8980ad56b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.689382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af302-5a11-4c82-8d4f-9de8980ad56b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.689382 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af302-5a11-4c82-8d4f-9de8980ad56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.721053 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-636af302-5a11-4c82-8d4f-9de8980ad56b None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:38.722261 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-636af302-5a11-4c82-8d4f-9de8980ad56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:38.731255 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1431/2873] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:38.752838 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c457-5bef-40f0-afc6-737b871060db None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:38.754318 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c038c457-5bef-40f0-afc6-737b871060db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:38.866633 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c457-5bef-40f0-afc6-737b871060db None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:38.873397 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:38.874002 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:38.874274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:38.874539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:38.882942 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:38.884569 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:38.895324 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1443/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:41.806535 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710edb7-982e-4d15-a1a9-e8163bf73f94 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:41.807150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710edb7-982e-4d15-a1a9-e8163bf73f94 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:41.807150 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710edb7-982e-4d15-a1a9-e8163bf73f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:41.827836 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4710edb7-982e-4d15-a1a9-e8163bf73f94 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:41.828980 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4710edb7-982e-4d15-a1a9-e8163bf73f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.840828 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1432/2875] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:41.865176 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:41.866664 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:41.881640 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaa49d-5f6b-4c72-852a-f4db29790665 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:41.889192 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:41.889971 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:41.890274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:41.890539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:41.902589 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:41.905300 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:41.920334 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1444/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:45.082424 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a453-ad89-4a7d-b330-00483da4cab8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:45.083001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a453-ad89-4a7d-b330-00483da4cab8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:45.083001 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a453-ad89-4a7d-b330-00483da4cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:45.102591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-aea5a453-ad89-4a7d-b330-00483da4cab8 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:45.103823 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aea5a453-ad89-4a7d-b330-00483da4cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:45.112529 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1433/2877] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:45.138238 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:45.150506 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6f19-bcf7-499a-b448-651df92e0fe3 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:45.158822 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:45.159660 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:45.159995 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:45.160331 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:45.174322 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:45.176962 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:45.191640 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1445/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:48.189265 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98f8e-17a9-4f4d-b117-e0a6b27d22dd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:48.189861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98f8e-17a9-4f4d-b117-e0a6b27d22dd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:48.189861 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98f8e-17a9-4f4d-b117-e0a6b27d22dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:48.213398 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-75b98f8e-17a9-4f4d-b117-e0a6b27d22dd None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:48.215009 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75b98f8e-17a9-4f4d-b117-e0a6b27d22dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:48.228339 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1434/2879] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:48.255637 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:48.268158 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a8105-8216-499f-988c-167d76307a95 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:48.276653 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:48.277261 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:48.277539 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:48.277898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:48.292922 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:48.295219 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:48.308342 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1446/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:51.388957 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44786-bc20-435f-ad89-9b73b50598e0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:51.389761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44786-bc20-435f-ad89-9b73b50598e0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:51.389761 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44786-bc20-435f-ad89-9b73b50598e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:51.420221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-35c44786-bc20-435f-ad89-9b73b50598e0 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:51.421771 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-35c44786-bc20-435f-ad89-9b73b50598e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:51.432829 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1435/2881] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:51.459425 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:51.474496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48472-1113-4ccd-a6db-2318c7ff32e6 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:51.482228 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:51.482765 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:51.483039 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:51.483303 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:51.493400 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:51.495899 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:51.509494 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1447/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:54.606972 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:54.607936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:54.607936 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:54.639448 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:17:54.640702 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:54.650098 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1436/2883] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:17:54.679526 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:54.691933 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef453b3-66ff-42c7-aa1d-a9fa4d8c17bc service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:54.699976 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:54.700575 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:54.700831 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:54.701098 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:54.709979 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:54.711577 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830972d0-00ff-4e2b-93c0-a29c959492b2 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:54.721417 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1448/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:04.452660 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:04.454234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:04.458154 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=19 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:04.560007 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d015c1-eb98-4088-852b-ea01fb286ac2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:04.565497 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:04.566088 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:04.566364 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:04.566634 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:04.568522 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:04.580801 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:04.582388 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0c33-13d4-4b37-88ee-5178c084aec7 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:04.593382 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1437/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:04.717126 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=76 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:09.909491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:09.909491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:09.909491 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:09.934833 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] MFA Rules not processed for user `a5164b2c08824774a5a65496cebba6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:09.936006 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:09.943574 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1449/2886] 10.222.0.23 () {58 vars in 958 bytes} [Sun Aug 21 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:18:14.588273 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=40 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:16.933767 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:16.934348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:16.934348 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:16.964699 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] MFA Rules not processed for user `c94db960d5bd475da8b98ca7c4c699b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:16.965876 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:17.021587 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1438/2887] 10.222.0.23 () {58 vars in 967 bytes} [Sun Aug 21 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:17.070351 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:17.071892 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:17.146536 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8662a-b226-4578-8d50-3201be878a0f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:17.152617 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9842b5bcc876492e9e765c86a3ba3138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:17.153224 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:17.153496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:17.153759 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:17.162873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:17.164504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:17.172403 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1450/2888] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Aug 21 01:18:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:24.327920 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:24.329383 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:24.345898 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c610f-d158-4b27-94a1-6f2b363873b5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:24.350712 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:24.351481 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:24.351804 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:24.352084 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] PATH_INFO: `/v3/users/8cfe1463710644e78d115ee24aa52fb5` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:24.353234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfe1463710644e78d115ee24aa52fb5)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:24.355248 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:24.413513 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfe1463710644e78d115ee24aa52fb5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.430221 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfe1463710644e78d115ee24aa52fb5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.440214 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfe1463710644e78d115ee24aa52fb5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.440955 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfe1463710644e78d115ee24aa52fb5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.441637 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfe1463710644e78d115ee24aa52fb5'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.456602 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1439/2889] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:24 2022] DELETE /identity/v3/users/8cfe1463710644e78d115ee24aa52fb5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:24.638854 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:24.650999 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df5fd9-c89e-4e2c-9c69-537c36dffbf6 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:24.708268 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:24.708889 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:24.709167 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:24.709432 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] PATH_INFO: `/v3/projects/83511d6d4a2b4bd19c0f7608742a2a53` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:24.710584 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83511d6d4a2b4bd19c0f7608742a2a53)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:24.712527 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:24.763274 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83511d6d4a2b4bd19c0f7608742a2a53', 'request_id': 'req-f52daeea-70d0-45e5-86d4-ca622407fbd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.768658 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83511d6d4a2b4bd19c0f7608742a2a53', 'request_id': 'req-f52daeea-70d0-45e5-86d4-ca622407fbd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.779624 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83511d6d4a2b4bd19c0f7608742a2a53', 'request_id': 'req-f52daeea-70d0-45e5-86d4-ca622407fbd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.790946 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] The token cache is being invalidate because project 83511d6d4a2b4bd19c0f7608742a2a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:24.791231 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.791973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.793558 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1451/2890] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:24 2022] DELETE /identity/v3/projects/83511d6d4a2b4bd19c0f7608742a2a53 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:24.797854 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:24.799322 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:24.813819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3d01-3656-42aa-bfe3-a164d161898d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:24.892230 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:24.892863 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:24.893136 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:24.893396 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] PATH_INFO: `/v3/users/a50ec202c7754220b7e08678b7bfaecc` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:24.894569 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50ec202c7754220b7e08678b7bfaecc)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:24.896746 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:24.907215 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:24.945327 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50ec202c7754220b7e08678b7bfaecc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.957591 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50ec202c7754220b7e08678b7bfaecc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.966121 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50ec202c7754220b7e08678b7bfaecc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.966829 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50ec202c7754220b7e08678b7bfaecc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.967514 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9e962a00-a76b-4cc1-b552-33fdd03deb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50ec202c7754220b7e08678b7bfaecc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:24.979891 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1440/2891] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:18:24 2022] DELETE /identity/v3/users/a50ec202c7754220b7e08678b7bfaecc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:25.157457 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:25.158970 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.175105 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52daeea-70d0-45e5-86d4-ca622407fbd1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:25.186504 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:25.240739 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:25.241280 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:25.241538 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:25.241857 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] PATH_INFO: `/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:25.243051 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a3d85cc9c9430f8c2119de7e72fe4b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:25.245004 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:25.310260 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a3d85cc9c9430f8c2119de7e72fe4b', 'request_id': 'req-e67d804e-10f7-4ea9-8d77-8505bafc07e1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.316573 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a3d85cc9c9430f8c2119de7e72fe4b', 'request_id': 'req-e67d804e-10f7-4ea9-8d77-8505bafc07e1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.326248 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a3d85cc9c9430f8c2119de7e72fe4b', 'request_id': 'req-e67d804e-10f7-4ea9-8d77-8505bafc07e1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.337898 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] The token cache is being invalidate because project b5a3d85cc9c9430f8c2119de7e72fe4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:18:25.338184 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.338830 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:18:25.340374 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1452/2892] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:25 2022] DELETE /identity/v3/projects/b5a3d85cc9c9430f8c2119de7e72fe4b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:18:25.873223 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ab07-b8e7-4b0f-9bb3-1f5c0b6fc441 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:25.873784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ab07-b8e7-4b0f-9bb3-1f5c0b6fc441 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:25.873784 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ab07-b8e7-4b0f-9bb3-1f5c0b6fc441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:25.894174 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9cf4ab07-b8e7-4b0f-9bb3-1f5c0b6fc441 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:25.895401 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9cf4ab07-b8e7-4b0f-9bb3-1f5c0b6fc441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:25.966667 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1441/2893] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:25.986981 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:25.988684 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:26.063511 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d804e-10f7-4ea9-8d77-8505bafc07e1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:26.069828 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:26.070434 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:26.070707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:26.070973 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:26.078997 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:26.080708 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:26.089882 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1453/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:29.177159 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e835-87b8-465e-9d27-8a2afbbe1611 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.177795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e835-87b8-465e-9d27-8a2afbbe1611 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.177795 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e835-87b8-465e-9d27-8a2afbbe1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.202235 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bf06e835-87b8-465e-9d27-8a2afbbe1611 None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:29.203438 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bf06e835-87b8-465e-9d27-8a2afbbe1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:29.212883 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1442/2895] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:29.233707 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:29.236416 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:29.253844 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8ea6-af6d-4f36-ab7f-a5faa9c20561 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:29.260090 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:29.260675 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:29.260944 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:29.261221 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:29.270054 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:29.271646 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:29.281650 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1454/2896] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:32.280310 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27a60-9c33-4301-8c61-6748afa0f77c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:32.280866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27a60-9c33-4301-8c61-6748afa0f77c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:32.280866 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27a60-9c33-4301-8c61-6748afa0f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:32.300945 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dee27a60-9c33-4301-8c61-6748afa0f77c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:32.302123 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dee27a60-9c33-4301-8c61-6748afa0f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:32.310538 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1443/2897] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:32.333312 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:32.345725 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab89-7ce8-45e5-a022-9b5910014e72 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:32.352496 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:32.353076 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:32.353346 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:32.353611 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:32.362873 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:32.364522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:32.374155 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1455/2898] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:37.524288 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11a09-8982-4002-9f39-a0d0b162320c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.524867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11a09-8982-4002-9f39-a0d0b162320c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.524867 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11a09-8982-4002-9f39-a0d0b162320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.547374 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-abe11a09-8982-4002-9f39-a0d0b162320c None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:37.548531 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-abe11a09-8982-4002-9f39-a0d0b162320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:37.557942 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1444/2899] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:37.580808 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:37.586548 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:37.593590 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff186340-f94a-4253-a8cc-70ae47613abc service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:37.600492 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:37.601091 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:37.601365 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:37.601631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:37.609769 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:37.611360 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:37.621219 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1456/2900] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:18:40.712294 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:40.712819 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:40.712935 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:40.732959 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] MFA Rules not processed for user `3eef813adda9492db76f71cbcb6b6625`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:18:40.734192 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:18:40.742628 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1445/2901] 10.222.0.64 () {58 vars in 1016 bytes} [Sun Aug 21 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:18:40.775164 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:18:40.788812 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6a9f-86c0-485b-a39e-503bed367a3f service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:18:40.794666 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafb054c1ff2433ca610bd9b50466720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:18:40.795314 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:18:40.795631 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:18:40.795964 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:18:40.804198 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:18:40.805775 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:18:40.815764 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1457/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:18:50.727381 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=10,keystone:SELECT=61,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:50.811044 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=11 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:08.961909 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:08.964234 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:09.023931 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:09.026716 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:09.040544 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b9ee-a0a5-4117-abc0-550e5237ad7f service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:09.045836 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:09.046027 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754c2b-76ad-4b80-97bf-ada5b97af12a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:09.046468 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.046747 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.047177 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] PATH_INFO: `/v3/users/a5164b2c08824774a5a65496cebba6cd` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.048517 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5164b2c08824774a5a65496cebba6cd)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:09.050452 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:09.051094 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:09.051724 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.052066 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.052339 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.054108 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:19:09.067117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:09.068910 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:09.080164 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1446/2903] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:19:09.109214 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5164b2c08824774a5a65496cebba6cd'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.109920 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5164b2c08824774a5a65496cebba6cd'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.118062 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5164b2c08824774a5a65496cebba6cd'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.126777 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5164b2c08824774a5a65496cebba6cd'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.138883 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5164b2c08824774a5a65496cebba6cd'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.144757 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1458/2904] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Aug 21 01:19:09 2022] DELETE /identity/v3/users/a5164b2c08824774a5a65496cebba6cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:09.350974 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:19:09.362592 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480f92-df73-4936-ab82-72881cd0da3b service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:19:09.439023 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eef813adda9492db76f71cbcb6b6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977498717dcb4d37929af17aaaa0285d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:19:09.439564 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:19:09.439873 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:19:09.440117 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] PATH_INFO: `/v3/projects/f2dfc95caa9e46c68307e86fa6b73acd` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:19:09.441826 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2dfc95caa9e46c68307e86fa6b73acd)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:19:09.444331 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:19:09.499956 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2dfc95caa9e46c68307e86fa6b73acd', 'request_id': 'req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.505644 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2dfc95caa9e46c68307e86fa6b73acd', 'request_id': 'req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.513620 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2dfc95caa9e46c68307e86fa6b73acd', 'request_id': 'req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.524356 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] The token cache is being invalidate because project f2dfc95caa9e46c68307e86fa6b73acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:19:09.524642 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.525756 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ee71e80-92c9-4f21-b93e-1d00ea87ae53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:19:09.527263 dv-cinder-master-3-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1447/2905] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:09 2022] DELETE /identity/v3/projects/f2dfc95caa9e46c68307e86fa6b73acd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:19:19.141321 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:19.521503 dv-cinder-master-3-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:10.500627 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:23:10.502294 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:10.594463 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed320-2f50-45db-bb84-eadd12396633 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:23:10.792522 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167a92c0eb6d4e609b369e8c359b94cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08376a0183204ce3a82064609e00c5f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:23:10.793149 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:23:10.793418 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:23:10.793686 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:23:10.795615 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:23:10.807967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:23:10.809592 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742c62b-ef9d-427c-926f-d732332cfb84 service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:23:10.820795 dv-cinder-master-3-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1459/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Aug 21 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:23:20.815967 dv-cinder-master-3-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=58 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}